Location
8:30 - 9:00
9:00 - 9:45
9:45 - 10:30
Abstract:
XR technology is increasingly being utilized for skill training in contexts that transcend the limitations of personnel, space, and time—such as evacuation drills through disaster simulations and the acquisition of surgical techniques.
Prof. Kurazume has developed a wide range of XR-based training systems across various domains, including coexistence with service robots, nursing care, construction, and art appreciation.
This presentation introduces a training system for Humanitude, a caregiving approach that has gained attention in dementia care, as well as a facilitator training system for interactive guided experiences using XR technology and large language models (LLMs).
10:30 - 11:00 Coffee Break
11:00 - 11:45
Exploring the Potential of MR-Based Remote Teleoperation: Learning from Earth-Based Systems for Possible Space Use
Abstract:
Teleoperation can be described as the remote control of a robotic system to carry out tasks in environments that are physically separated from the operator. When this physical distance exists, it becomes especially important for the operator to receive timely and complete feedback to properly perceive and interact with the remote setting. This is particularly true for complex or mission-critical tasks, which often require multisensory feedback—such as visual, auditory, and haptic (touch) input. In some cases, olfactory (smell) and gustatory (taste) feedback may also be considered, though these are far less common.
High-resolution feedback—especially visual and haptic—is important for giving operators accurate and detailed information. However, in practice, many teleoperation scenarios take place in unstructured and unpredictable environments, which introduce significant technical challenges. These are often related to limitations in communication bandwidth, latency, and reliability, all of which can reduce the quality and fidelity of the feedback delivered to the operator.
In this presentation, I will present our work at the Italian Institute of Technology on a mixed reality-based teleoperation interface designed for ground-based robotic control. I will outline the technological developments we have pursued to enhance high-resolution visual feedback for operators, along with improvements in robotic manipulation, sensor integration, and user interface design. Additionally, I will address some of the practical challenges we encountered during remote teleoperation and reflect on how these findings may inform future space-based teleoperation efforts—where communication delays and environmental unpredictability are even more pronounced.
11:45 - 12:30
Frontier Innovation for Telerobotic Rescue and Recovery
Abstract:
The unpredictable and unstructured nature of the frontier environment has a way of inspiring innovation and creativity with immediate problem-solving potential for crisis assessment and response. This talk opens with an overview of risk assessment as it pertains to human relationships and the daunting challenges associated with emergency response activities. A cognitive analysis of human machine teaming follows with emphasis on the need for artificially intelligent collaborative alternatives to the brute force aggregate approach. The development of wrapping manipulators inspired by the phenomenal abilities of cephalopods is then presented as one example of how a frontier environment can inspire humans to innovate via the compelling combination of self-preservation and insatiable curiosity. The conclusion drawn from marine biology, cognitive science, and personal experience, is that decentralized yet collaborative activities demonstrated by squid and octopus limbs can serve as a powerful metaphor with which to model future systems engaged in telerobotic rescue and recovery.
Lunch 13:00 - 14:00
14:00 - 14:30
Abstract:
In upcoming space exploration activities, robotics and automation integration are essential technologies to ensure effective and efficient mission realizations. Robotic missions are invaluable for exploring hazardous or unreachable environments and conducting pre-planned or long-term tasks, while crewed missions offer dexterity and flexibility of the missions. Considering the growing need for increased cost-effectiveness and the expanding needs of human spaceflight missions, synergies between robotic and human-centered missions are anticipated. This presentation will present the JAXA’s vision of such human robotic partnership in space and share our R&D activities, including ISS tests of the intra-vehicular robot (Int-Ball2 and upcoming demos) as well as anticipated lunar exploration with JAXA/Toyota pressurized rover.
14:30 - 15:15
Beyond Transparency in Telerobotics: Model-Augmented Haptic Telemanipulation for Teleoperation in Space
Abstract:
Telepresence is a cornerstone technology for the New Era of Space Exploration, enabling humans to combine their mental abilities and expertise with the accuracy and sensitivity of robotic systems. Building on our earlier work in model-augmented haptic telemanipulation (MATM), which integrates advanced control methods, shared autonomy, and haptic augmentation, we present recent advances that establish MATM as a framework for space telepresence. In 2025, DLR successfully conducted a multi-robot teleoperation experiment in which an astronaut aboard the ISS controlled a team of robots on Earth. This experiment demonstrated the benefits of MATM’s flexibility in multi-agent scenarios, maintaining task efficiency despite communication delays. Another promising application is On-Orbit Servicing (OOS), where MATM will enable stable force-feedback control, improve manipulation precision, and enhance operational safety for satellite repair and in-space assembly. This talk provides a summary of the MATM concept and of the telerobotic missions in which DLR has been involved. It illustrates selected novel control concepts for stable teleoperation and highlights terrestrial applications that benefit from MATM. Finally, the talk will outline open challenges and future directions for MATM.
15:15 - 16:00
Current and Future Approaches for Space and Terrestrial Teleoperation
Abstract:
This talk will present the progress in teleoperation and control technologies enhancing human-robot interaction, with a particular focus on improving both precision and safety. It will cover the teleoperation control approaches tested in space and terrestrial applications, highlighting how bilateral, multilateral, and shared autonomy controllers are used to ensure stability, safety, and transparency while safeguarding both the operator and the robotic system. Beyond the standard design considerations, this talk will also examine additional critical factors that must be addressed to truly enhance teleoperation effectiveness. Control strategies, innovative devices and scalable autonomy will be shown to tackle these challenges and elevate the performance and scope of teleoperated systems. Through experiments drawn from domains including space, ground assistance, and humanitarian application, the talk will illustrate how teleoperation continues to evolve.
Coffee Break 16:00 - 16:30
16:30 - 18:00
Moderators: Dr. Neal Y. Lii and Dr. Ashitey Trebi-Ollennu
Panelist:
Dr. Adrian Stoica (IEEE SMC President)
Dr. John Blitch (Lt. Col, US Army, ret., President and CEO, Blitz Solutions LLC)
Dr. Seiko Yamaguchi (JAXA)
Mr. Lionel Ferrra (ESA)
Dr. Thomas Hulin (DLR)
Dr. Harsimran Singh (DLR)
Mr. Tilo Würsthoff (DLR, human-robot interaction and industrial design expert )
18:00 - 18:30
Closing remarks from IEEE SMC President and networking with Workshop participants, and workshop Organizers
19:30 - 21:00
SMC 2025 Welcome Reception