Geometric and Algebraic Structure in Robot Learning
Workshop at RSS 2024
July 19th, 2024
Delft, Netherlands
Introduction
Most robotic applications, including manipulation, navigation and locomotion, require our robots to interact with the physical world, which is rich in geometric and algebraic structures. This workshop is intended to provide a forum to discuss whether and how similar geometric and algebraic structures can benefit various aspects of robot learning, including perception, planning, control, and beyond.
Robot learning researchers have exploited different forms of geometric and algebraic structure to improve efficiency, generalization capability, robustness, scalability, etc. for different aspects of robot learning. In perception and representation learning, researchers exploit the geometric and algebraic structure of disentangled representation, factored or symbolic features, and compositional scene understanding. In decision-making, these structures have been explored in reinforcement learning and planning algorithms through geometric deep learning, skill learning, goal-conditioned learning, and language compositionality. The goal of this workshop is to bring together researchers who work on different aspects of robot learning, identify common tools and methodologies for incorporating geometric and algebraic structures for robot learning, and potentially foster new ideas on leveraging such structures.
The intended audience is primarily researchers in robot learning, especially those who are interested in enhancing learning efficiency, generalization capability, robustness, scalability, etc. of pure data-driven approaches. The intended audience also includes (non-learning) roboticists and theory researchers who are knowledgeable in areas such as group theory, representation theory, category theory, symbolic reasoning, etc., and would like to explore robot learning as a potential application scenario.
Discussion Topics:
What robotics applications benefit from having geometric and algebraic structures, such as manipulation, navigation, locomotion, etc?
How to build practical learning algorithms that can leverage structures and be applied to real-world physical robots?
How can geometric and algebraic structures, such as spatial (e.g., objects), temporal (e.g., skills), or parallel (e.g., multi-objectives) compositionality, be formulated with mathematical tools?
What types of geometric and algebraic structures exist in robot learning? Are there any symmetries worth considering beyond Euclidean symmetry (translation, rotation, reflection) and permutation symmetry, such as scale equivariance?
What practical benefits do they bring to robotics, especially robot learning, such as generalizability, efficiency, and scalability? How can they aid the robotics stack, such as perception, planning, and control?
How do symmetry and compositionality interact? For example, to grasp multiple objects, the algorithm needs to consider both object symmetry and object interchangeability (compositionality).
…
Invited Speakers
Kostas Daniilidis
UPenn
Katerina Fragkiadaki
CMU
Gregory Chirikjian
NUS
Robert Platt
Northeastern
Jan Peters
TU Darmstadt
Tentative Schedule
Time
1:45 pm - 2:00 pm
2:00 pm - 2:30 pm
2:30 pm - 3:00 pm
3:00 pm - 3:30 pm
3:30 pm - 4:00 pm
4:00 pm - 4:30 pm
4:30 pm - 5:00 pm
5:00 pm - 5:30 pm
5:30 pm - 6:00 pm
6:00 pm - 6:10 pm
Session
Introduction
Talk 1
Talk 2
Lightning Round & Poster
Coffee Break & Posters
Talk 3
Talk 4
Talk 5
Panel
Closing Remarks (& Awards)
Organizers
Contact
Please feel free to reach out to [EMAIL] for any questions.