Zhe Huang*, Ye-Ji Mun*, Xiang Li†, Yiqing Xie†, Ninghan Zhong†,
Weihang Liang, Junyi Geng, Tan Chen, and Katherine Driggs-Campbell
Univeristy of Illinois at Urbana-Champaign
ICRA 2023
Collaborative robots require effective human intention estimation to safely and smoothly work with humans in less structured tasks such as industrial assembly, where human intention continuously changes. We propose the concept of intention tracking and introduce a collaborative robot system that concurrently tracks intentions at hierarchical levels. The high-level intention is tracked to estimate human’s interaction pattern and enable robot to (1) avoid collision with human to minimize interruption and (2) assist human to correct failure. The low-level intention estimate provides robot with task related
information. We implement the system on a UR5e robot and demonstrate robust, seamless and ergonomic human-robot collaboration in an ablative pilot study of an assembly use case.
In less structured human-robot collaboration tasks,
human intention usually changes at different stages;
human intention is often composed of a multi-layer hierarchy.
To take these factors into account,
we derive intention tracking with a graphical model of human-robot collaboration where human intention is a Markov process;
we extend intention tracking to intention hierarchy with arbitrary number of layers.
Perform intention tracking from bottom to top levels;
Infer maximum likelihood intention estimate from top to bottom level (highlighted).
g: human intention, Markov process;
x: observed human/robot state;
l: intention level;
Tp: update time steps.
The human aligns male parts from preparation area to female parts at different locations;
The robot performs assembly action after part alignment is finished;
When an assembly failure happens, the human guides the robot to recover the failure;
The human leads the team to accomplish all goals in a desired task sequence which is unknown to the robot;
The robot uses observed human behavior to safely and efficiently collaborate with the human.
Hierarchical Intention Tracking based Human-Robot Collaboration system allows human to seamlessly collaborate with robot by freely switching interactive intentions, to guarantee 100% task success by paying minimum effort on guidance, and to enhance ergonomics by avoiding impact force during assembly action;
Hierarchical Intention Tracking reaches 90.4% frame-wise accuracy for low-level intention and 94.5% for high-level intention.