2026 IEEE International Conference on Robotics & Automation (ICRA)
Humans and many animals subconsciously choose robust ways of selecting and using tools, based on years of embodied experience—for example, humans choose a ladle instead of a flat spatula to serve meatballs. However, robustness under uncertainty remains underexplored in robotic tool-use planning.
This paper presents a robustness-aware framework that jointly selects tools and plans contact-rich manipulation trajectories, explicitly optimizing for robustness against environmental disturbances. At the core of our approach is a learned, energy-based robustness metric, which guides the planner towards robust manipulation behaviors.
We evaluate our approach across three representative tool-use tasks. Simulation and real-world results demonstrate that our approach consistently selects robust tools and generates disturbance-resilient manipulation plans.
Failure 1
Description: The suction cup failed to create a secure seal due to pose estimation errors, causing the scissors to drop prematurely.
Analysis: This highlights the sensitivity of real-world grasping to scene variations and visual perception noise.
Failure 2
Description: The scissors collided with the hook and wall mid-trajectory due to slight spatial misalignment.
Analysis: This demonstrates the challenge of the epistemic uncertainties, such as the pose of hooks and the actuation profile.
Here you can find the robustness guidance dataset of our three tasks, consisting of tool-object configurations with corresponding MEE values (our method) or PCC (baseline) values, as well as tool and object model files.