Learning Complex Motion Plans using Neural ODEs with Safety and Stability Guarantees
accepted to ICRA 2024
Farhad Nawaz*, Tianyu Li, Nikolai Matni, Nadia Figueroa
*farhadn@seas.upenn.edu
Learning Complex Motion Plans using Neural ODEs with Safety and Stability Guarantees
accepted to ICRA 2024
Farhad Nawaz*, Tianyu Li, Nikolai Matni, Nadia Figueroa
*farhadn@seas.upenn.edu
Oral presentation at 4:30 PM, Thursday, 16 May, room CC-502 #ICRA2024
Abstract: We propose a Dynamical System (DS) approach to learn complex, possibly periodic motion plans from kinesthetic demonstrations using Neural Ordinary Differential Equations (NODE). To ensure reactivity and robustness to disturbances, we propose a novel approach that selects a target point at each time step for the robot to follow, by combining tools from control theory and the target trajectory generated by the learned NODE. A correction term to the NODE model is computed online by solving a quadratic program that guarantees stability and safety using Control Lyapunov Functions (CLFs) and Control Barrier Functions (CBFs), respectively. Our approach outperforms baseline DS learning techniques on the LASA handwriting dataset and complex periodic trajectories. It is also validated on the Franka Emika robot arm to produce stable motions for wiping and stirring tasks that do not have a single attractor, while being robust to perturbations and safe around humans and obstacles.
Kinesthetic teaching
Execution: human interaction
Kinesthetic teaching
Execution with disturbances
Execution with disturbances
Kinesthetic teaching
Nominal task execution
Dynamic obstacle avoidance
Stirring pan: the blue arrow denotes a perturbation away from the nominal target trajectory
Wiping mannequin
Wiping whiteboard: the purple spheres denote the moving obstacle at different time
Please click on the below plots to open and interact with it
Demonstrations from Franka robot and corresponding NODE predictions: {1, 2, 3} denote each column of the rotation matrix.
NODE model for predicting full pose
Position
Orientation
Pouring
Plate stacking
Box opening
Bottle shelving
Motion plan using only NODE
Motion plan using the corrected CLF-NODE
I Shape
O Shape
S Shape
Wiping a white board
Wiping a mannequin