Learning Meets Model-based Methods for Manipulation and Grasping

IEEE/RSJ IROS 2023 Workshop
Detroit, USA
October 5th, 2023

News

 

About

The 1st International Workshop “Learning Meets Model-based Methods for Manipulation and Grasping” will take place as part of IEEE/RSJ IROS 2023 on October 5th, 2023 in Detroit, USA.

This event upholds the IEEE RAS code of conduct to provide a safe, productive, and welcoming environment for all.


Awards

Best Paper Award

AnyGrasp: A Library for Human-level Grasp Perception in Cluttered and Dynamic Environments
Hao-Shu Fang (SJTU)*; Chenxi Wang (Shanghai Jiao Tong University); Hongjie Fang (Shanghai Jiao Tong University); Minghao Gou (Shanghai Jiao Tong University); Jirong Liu (Shanghai JiaoTong University); Hengxu Yan (Shanghai Jiao Tong University); Wenhai Liu (Shanghai Jiao Tong University); Yichen Xie (shanghai jiao tong university); Cewu Lu (Shanghai Jiao Tong University)
Paper

Ex-aequo with

Dynamic-Resolution Model Learning for Object Pile Manipulation
Yixuan Wang (University of Illinois at Urbana-Champaign); Yunzhu Li (Stanford University & University of Illinois at Urbana-Champaign)*; Katherine Driggs-Campbell (University of Illinois at Urbana-Champaign); Li Fei-Fei (Stanford University); Jiajun Wu (Stanford University)
Paper

Agile Robots Best Student Paper Award

Learning Plan-Satisficing Motion Policies from Demonstrations
Yanwei Wang (MIT)*; Nadia Figueroa (UPenn); Shen Li (MIT); Ankit Shah (Brown University); Julie Shah (MIT)
Paper

Runner-up Best Student Paper Award

Neural Field Movement Primitives for Joint Modelling of Scenes and Motions
Ahmet Tekden (Chalmers University of Technology)*; Marc Deisenroth (University College London); Yasemin Bekiroglu (Chalmers)
Paper Video

Abstract

Building robots capable of dexterous interaction with objects to carry out fine manipulation tasks has always been a grand challenge in robotics. The non-smooth, brittle nature of manipulator-object mechanics, together with perceptual uncertainty, easily violate the assumptions of early planning and control methods. Furthermore, accurate physical modeling of complex or non-rigid mechanical systems requires large amounts of computations, which is incompatible with real-time control.

Such challenges led researchers to develop a wide range of approaches, from adaptive control tailored to the (potentially changing) properties of the object at hand, to advanced perception to tackle measurement uncertainty. Machine learning also contributed by providing actionable representations of complex geometries and visual appearance, and by encoding hard-to-model expert demonstrations to reduce the cost of trial-and-error. In turn, these informed the development of novel robot control methods enabling more robust and dexterous skills. At the same time, the employment of mechanical models proved effective for enforcing structural constraints in robot control systems (including learning-based ones), thus improving safety and guiding exploration.

However, there are still many open challenges that need to be addressed to achieve long-horizon robotic manipulation and sidestep the computational burden of accurate simulation of contact-rich scenarios. The ambition of this workshop is to provide a comprehensive overview of the broad and scattered state of the art in robot manipulation and grasping, spanning model-based and learning-based approaches. Talks and interactive sessions will enable a deeper understanding of current approaches in different use cases, while stimulating the development of new methods.

Gold Sponsor

Agile Robots AG is an international high-tech company based in Munich, Germany, with more than 1,000 employees worldwide. Our mission is to bridge the gap between artificial intelligence and robotics by developing systems that combine state-of-the-art force-moment sensing and world-leading image processing technology. This unique combination of technologies allows us to provide user-friendly and affordable robotic solutions that enable intelligent precision assembly. 


Acknowledgments

IEEE RAS Technical Committee on Model-based Optimization for Robotics

This workshop has been organized within FAIR - Future Artificial Intelligence Research and received funding from the European Union Next-GenerationEU (PIANO NAZIONALE DI RIPRESA E RESILIENZA (PNRR) – MISSIONE 4 COMPONENTE 2, INVESTIMENTO 1.3 – D.D. 1555 11/10/2022, PE00000013). This workshop reflects only the authors’ views and opinions, neither the European Union nor the European Commission can be considered responsible for them.