Roboticists frequently turn to Imitation learning (IL) for data efficient policy learning. Many IL methods, canonicalized by the seminal work on Dataset Aggregation (DAgger), combat distributional shift issues with older Behavior Cloning (BC) methods by introducing oracle experts. Unfortunately, access to oracle experts is often unrealistic in practice; data  frequently comes from manual offline methods such as lead-through or teleoperation. We present a data-efficient imitation learning technique called Collocation for Demonstration Encoding (CoDE) that operates on only a fixed set of trajectory demonstrations by modeling learning as empirical risk minimization . We circumvent problematic back-propagation through time problems by introducing an auxiliary trajectory network taking inspiration from collocation techniques in optimal control. Our method generalizes well and is much more data efficient than standard BC methods. We present experiments on a 7-degree-of-freedom (DoF) robotic manipulator learning behavior shaping policies for efficient tabletop operation .
 Imitation learning (IL) is a frequently used approach for data-efficient policy learning. Many IL methods, such as Dataset Aggregation (DAgger), combat challenges like distributional shift by interacting with oracular experts. Unfortunately, assuming access to oracular experts is often unrealistic in practice; data used in IL frequently comes from offline processes such as lead-through or teleoperation. In this paper, we present a novel imitation learning technique called Collocation for Demonstration Encoding (CoDE) that operates on only a fixed set of trajectory demonstrations . We circumvent challenges with methods like back-propagation-through-time by introducing an auxiliary trajectory network , which takes inspiration from collocation techniques in optimal control. Our method generalizes well and more accurately reproduces the demonstrated behavior with fewer guiding trajectories when compared to standard behavioral cloning methods. We present simulation results on a 7-degree-of-freedom (DoF) robotic manipulator that learns to exhibit lifting, target-reaching, and obstacle avoidance behaviors .
D
Roboticists frequently turn to
R
for data efficient
is a frequently used approach for data-efficient
R
canonicalized by the seminal work on
such as
R
distributional shift issues with older Behavior Cloning (BC) methods by introducing oracle
challenges like distributional shift by interacting with oracular
R
access to oracle
assuming access to oracular
A
used in IL
R
manual offline methods
offline processes
R
We present a data-efficient
In this paper, we present a novel
D
by modeling learning as empirical risk minimization
R
problematic back-propagation through time problems
challenges with methods like back-propagation-through-time
R
taking
, which takes
R
is much more data efficient than standard BC
more accurately reproduces the demonstrated behavior with fewer guiding trajectories when compared to standard behavioral cloning
R
experiments
simulation results
R
learning behavior shaping policies for efficient tabletop operation
that learns to exhibit lifting, target-reaching, and obstacle avoidance behaviors