Yifei Simon Shao, Tianyu Li, Shafagh Keyvanian, Pratik Chaudhari, Vijay Kumar, Nadia Figueroa
Presented at Robotics Science and Systems (RSS) 2024
Constraint-aware estimation of human intent is essential for robots to physically collaborate and interact with humans. Further, to achieve fluid collaboration in dynamic tasks intent estimation should be achieved in real-time. We present a framework that combines online estimation and control to facilitate robots in interpreting human intentions, and dynamically adjusting their actions to assist in dynamic object co-manipulation tasks while considering both robot and human constraints. Central to our approach is the adoption of a Dynamic Systems (DS) model to represent human intent. Such a low-dimensional parameterized model, along with human manipulability and robot kinematic constraints, enables us to predict intent using a particle filter solely based on past motion data and tracking errors. For safe assistive control, we propose avariable impedance controller that intelligently adapts the robot’s impedance to offer assistance based on the intent estimation confidence from the DS particle filter. We validate our framework on a challenging real-world human-robot co-manipulation task and presenting promising results over baselines. Our framework represents a significant step forward in physical human-robot collaboration (pHRC), promising to extend the application of robots in various sectors by ensuring their cooperative interactions with humans are both feasible and effective.
Inspired by human-human co-manipulation, in this work, we seek to endow robots with the capability to estimate the human’s intent solely from physical guidance while considering kinematic and feasibility constraints of both the agents for fluid human-robot object co-manipulation tasks. Three main challenges need to be addressed to achieve this:
Intent Estimation
How can the robot estimate the human’s intent in terms of task goal and desired motion?
In certain scenarios combining goal estimation and motion estimation could yield better performance. In this work, we show that combining goal estimation and motion estimation is highly beneficial in co-manipulation scenarios as exposing both the motion and the goal to the algorithm, we not only gain fluid task execution but also ensure safety and feasibility.
Role Adaptation
When should the robot switch between leader/follower roles in interacting with the human?
Correct transition is crucial in ensuring safe and effortless operation when working with robots with significant payload capacity. Our work introduces a novel approach in which an estimation confidence measure is used to adjust the controller gains. Hence, the robot will only provide active assistance with a high-confidence estimation of intent.
Constraint Satisfaction
How to consider kinematic and feasibility constraints for both agents in performing the task?
The co-manipulation task involves a physical coupling/connection between the robot and the human via the co-manipulated object. Both human and robot motion capability could be limited by reachability, joint limits, external collision, self-collision, etc. In this work, we consider reachability and joint limits as robot constraints, assuming there are no external obstacles and self-collision. While robot motion capability is more straightforward to model, human capability requires more careful treatments since humans have the freedom to move. Therefore, our work considers the manipulability ellipsoid as the constraint for human motion. Such manipulability ellipsoid could help generate co-manipulation motions with more comfort.
We focus on HRC tasks with robot being capable of assisting in rotational commands, for instance, when rolling a heavy pot, reducing torque on the human wrist. In such scenarios, robot also needs to be robust to variable weight of the object.
We propose an intent estimation method, while considering both agents’ capability and task feasibility. Robot switches role between leader and follower smoothly, to reduce human's effort, making the robot more capable than a human partner.
We predict human intent, including goal and motion, in co-manipulation tasks by estimate the parameters of a 6D DS motion policy using particle filters driven by velocity tracking errors, without force-torque sensing.
We propose a confidence-based variable impedance control scheme suited to track the estimated 6D DS motion policy. By estimating the confidence of our particle filter predictions our method fluently decides when to offer active or passive assistance without a force/torque sensor.
We ensure goal/motion feasibility during intent estimation by trimmimg and reshaping particles using robot kinematic constraints and human manipulability measures.
We validate our proposed constraint-aware intent estimation approach on a challenging co-manipulation task with real hardware experiments, showcasing improved performance over state-of-the-art techniques.
Methodology
Control diagram of proposed approach
Task dynamics refers to the combined dynamics in the Cartesian space. In the Particle Filters block, dynamics matrices and attractors are estimated online. These estimates along with their confidence are sent to the DS Variable Impedance Controller to generate desired force. A torque satisfying the constraints is send to the robot.
We gratefully acknowledge the support of The Institute for Learning-Enabled Optimization at Scale (TILOS) funded by the National Science Foundation (NSF) under NSF Grant CCR-2112665, IoT4Ag ERC funded through NSF Grant EEC-1941529
Contact [yishao@seas.upenn.edu] to get more information on the project.