Best Practices for Enabling Reproducible & Replicable Studies in Human-Robot Interaction
IEEE RO-MAN 2025 WORKSHOP
Best Practices for Enabling Reproducible & Replicable Studies in Human-Robot Interaction
IEEE RO-MAN 2025 WORKSHOP
Dr. Paul Robinette
Associate Professor in the Department of Electrical and Computer Engineering at the University of Massachusetts Lowell. Author of 2016 HRI paper, "Overtrust of robots in emergency evacuation scenarios." His research focuses on human-robot trust in time-critical situations in virtual simulations, the lab, and the field. Recent field robotics work includes in-situ human-robot teaming experiments in the marine domain which yielded the Aquaticus dataset that has been made publicly available to the HRI community
Dr. Shelly Levy-Tzedek
Associate Professor and the director of the Cognition, Aging & Rehabilitation Laboratory at Ben Gurion University. Author of 2018 HRI paper, "Differences between young and old users when interacting with a humanoid robot." Her lab studies the effects of age and disease (in particular, Parkinson's disease & stroke) on the control of body movement, and how to best employ robotics to facilitate a fast and efficient rehabilitation process. She has employed the participatory-design approach in the study of diverse technologies - from rehabilitation robots to sex robots. In recent years, she has been co-leading a global initiative to promote regulation of social robots for vulnerable populations.
Dr. Elaine Schaertl Short
Assistant Professor and the director of the Assistive Agent Behavior and Learning Lab in the Tufts University Department of Computer Science. Author of 2010 HRI paper, "No fair!! An interaction with a cheating robot" Her research lies at the intersection of assistive technology and social robotics (including socially assistive robotics), developing robots that can support people, especially children, older adults, and people with disabilities, in achieving their goals. A key focus of this work is understanding the user as embedded in a social and environmental context, designing new algorithms that allow robots learn from, interact with, and provide assistance to users in real-world environments such as schools, hospitals, and public spaces.
Dr. Maha Salem
User Experience (UX) Research Manager at WhatsApp in London leading the Integrity UX Research team. Author of 2015 HRI paper, "Would you trust a (faulty) robot? Effects of error, task type, and personality on human-robot cooperation and trust." Prior to working full-time in industry research, she spent almost 7 years conducting academic research. Her academic research background is highly multidisciplinary and combines a broad range of interests including multimodal communication, non-verbal expressiveness and motor control, safety and trust, as well as cultural differences in Human-Machine Interaction.
Dr. Cristina G. Wilson
Assistant Professor of Research in the Collaborative Robotics and Intelligent Systems Institute at Oregon State University. Wilson is a cognitive scientist specializing in human-robot teaming for uncertain and dynamic problem-solving, refining and deepening the decision support that mobile robots can provide to address the real-world challenges faced by domain experts.
Dr. Patrick Holthaus
Reader in Interactive Assistive Technology and Manager of the Robot House at The University of Hertfordshire, UK. He co-chairs the Study Design subgroup of IEEE P3108. His research revolves around social robotics and focuses on nonverbal interactive signals, social credibility and trust in assistive and companion robots.
Dr. Naomi Fitter
Associate Professor in the Collaborative Robotics and Intelligent Systems Institute at Oregon State University. Research interests include physical human-robot interaction, socially assistive robotics, haptics, robots in education, and robotic entertainers. Fitter aims to equip robots with the ability to engage and empower people in interactions from playful high-fives to challenging physical therapy routines.
Dr. Alessandra Rossi
Assistant Professor at the University of Naples Federico II, Italy. Alessandra is co-chairs the Study Design subgroup of IEEE P3108. Her research interests include social robotics in assistive and service applications, embodied AI, investigating and calibrating trust dynamics, XAI, multi-agent systems and user profiling.
Shelly Bagchi
Researcher at the U.S. National Institute of Standards and Technology. Shelly is the Project Lead for the Digital Twins and Emerging Technology for SMEs Project within the Measurement Science for Manufacturing Robotics Program at NIST. Her research interests are in human-robot interaction, replicability & reproducibility, and augmented reality. Shelly chairs the IEEE Standards Group P3108, Recommended Practice for Human-Robot Interaction Design of Human Subject Studies, and is the secretary for IEEE P3107, Standard Terminology for Human-Robot Interaction.
Dr. Bill Smart
Professor and Associate Director for Academics in the Collaborative Robotics and Intelligent Systems Institute at Oregon State University. Research interests cover the areas of human-robot interaction, long-term autonomy, software architectures for robotics, and the intersection of robots, law, and policy.
Dr. Daniel Hernández García
Research Fellow at Heriot-Watt University and the National Robotarium, Edinburgh, UK. His research lies at the intersection of HRI and AI, with a focus on developing socially aware robots with the capacity for cognitive interactions. Daniel is the secretary for the IEEE Standards Group P3108, Recommended Practice for Human-Robot Interaction Design of Human Subject Studies, and is the HCI Theme lead for the Scottish Informatics and Computer Science Alliance.
Dr. Ross Mead
Founder and Executive Director of Semio Community. Semio Community is a 501(c)(3) nonprofit organization facilitating community-driven robotics hardware, software, and studies to foster reproducible, replicable, and generalizable science within human-robot interaction. Semio Community actively encourages multidisciplinary collaboration among academia, industry, and the public sector to drive innovation, ethical practices, and the widespread adoption of human-centered robotics technologies.
Dr. Daniel Tozadore
Lecturer (Associate Professor) at University College London (UCL). He has more than 10 years of experience in Robotic Systems, acting on the following subjects: Human-Robot Interaction, Artificial Intelligence for Education, Convolutional Neural Network, Reinforcement Learning, Adaptive Systems and Graphical User Interface.
Postdoctoral Researcher at U.S. National Institute of Standards and Technology (NIST) and Adjunct Faculty at Immersive Media Design (IMD), University of Maryland (UMD) College Park. His research is at the intersection of Human-Robot Interaction, Artificial Intelligence (AI), and their real-world applications. He develops technology, tools, measurements, standards, and applications in these domains. He is interested in empowering people by creating super-tools that augment their capabilities. He is an active contributor of the standards working group IEEE P3017 Standard Terminology for Human-Robot Interaction and P3108 Recommended Practice for Human-Robot Interaction Design of Human Subject Studies and chairs the Subgroup 3 Metrics and Measurements.
Postdoctoral Researcher at Institut de Robòtica i Informàtica Industrial (IRII). He is a member of the Study Design subgroup of IEEE P3108. His work focuses on creating proactive, personalised robots that can tailor their behaviour to each individual’s unique needs and preferences. Additionally, he investigates how robots can explain their decisions, helping users build clearer mental models of these systems.
Dr. Wing-Yue Geoffrey Louie
Associate Professor and Director of the In Real Life Intelligent Robotics Lab at Oakland University. He is a member of the Study Design subgroup of IEEE P3108. His research interests include robot teaching and learning, personalization, human-robot interaction, and applications of video game technologies to robotics. The core theme of his research is on the development of robot technology that can be effortlessly taught by anyone. The primary application domain areas for his research are in healthcare, education, and defense.