Atlanta, GA, U.S.A.
23 May 2025
IEEE Working Group on Reproducibility: https://www.ieee-ras.org/soft-robotics/working-groups/reproducibility
Our final schedule is shown below. Please continue to scroll to find more detail on talks and discussions.
8:30-8:45: Open remarks by organizers
8:45-9:30: Keynote (Herb Shea)
9:30 - 10:00: Discussion #1 (Identifying reproducibility challenges)
10:00-10:20: Long Talk #1 (Adam Norton)
10:20-10:50: Coffee Break
10:50-11:30: Discussion #2 (Replication studies)
11:30-12:00: Poster Session
12:00-1:20: Lunch
1:20-1:40: Long Talk #2 (Robert Katzschmann)
1:40-2:00: Report from recent workshop, Benchmarking in Soft Robots (Speaker TBD)
2:00-2:30: Discussion #3 (Open Brainstorm on Supporting Reproducibility)
2:30-3:00: Coffee Break
3:00-3:40: Discussion #4 (Peer review guidelines on reproducibility - should we have them?)
3:40-4:00: Long Talk #3 (Sicheng Wang)
4:00-4:40: Discussion #5 (Case-study discussion on metrics)
4:40-5:00: Wrap-up
Wearable on-body robotics for haptics or for muscular assistance require compliant, efficient, fast, lightweight and high force actuators. I will present flexible actuators developed in my lab that operate on electrostatic principles, which can offer high speed and high energy density, but (for now) lower force than pneumatics. The electrostatic principle provides a clear path to untethered operation. I will report both fiber-format as well as patch-format devices, the former aimed at soft exoskeletons, the later for cutaneous haptics.
We all love to report impressive numbers for metrics such as efficiency and specific power. I will give a few examples of how our, often unstated, assumptions lead us to claim performance metrics different by orders of magnitude from reality. I close by suggesting a few routes to standardize our reporting.
Advancing robot manipulation implies that you are able to measure the state-of-the-art performance and then outperform it. To do so, objective performance metrics and evaluation methods are needed to benchmark robot manipulation capabilities. While many advancements have been made to develop common benchmarking tools, testbeds, protocols, and metrics, the high dimensionality of a robot manipulation system and the non-deterministic nature of their algorithms make true side-by-side comparison very challenging. Comparing results from one lab to those collected in another lab can be very misleading due to variances in hardware and environmental conditions. Instead, you can attempt to reproduce results from the other lab in your own lab to generate your own baseline for comparison, but we do not yet have the level of modularity and interoperability needed in order to easily facilitate reproduction. This talk will review the current state of reproducibility for “rigid” robot manipulation (as a counter to “soft” robotics), and how efforts like the COMPARE Ecosystem project aims to improve it.
Creating life-like robots that can perform dexterous tasks in the real world remains a central challenge in robotics. At the Soft Robotics Lab, our broader mission is to develop robust musculoskeletal and biohybrid robotic systems capable of adaptive, real-world interaction. In this talk, we will present ORCA, an Open-source, Reliable, Cost-effective, Anthropomorphic robotic hand designed to directly address the reproducibility challenges that often hinder progress in soft and compliant robotics. ORCA is a tendon-driven, 3D-printed platform featuring 17 degrees of freedom, reliable auto-calibration capabilities, and a fully open-source software and hardware stack. From mechanical design to electronics and control, every aspect of ORCA has been developed with reproducibility in mind, enabling consistent replication across multiple labs and supporting high-throughput experiments that range from robust teleoperation and accurate control to repeatable imitation and reinforcement learning policy rollouts. We will discuss how ORCA contributes to a more transparent and scalable research ecosystem, including shared CAD files, simulation models, assembly guides, and benchmarking experiments. This work exemplifies how open, community-oriented design can help overcome the reproducibility bottlenecks in soft robotics and facilitate broader adoption of dexterous robotic platforms.