1st Workshop on Replication in Extended Reality (WoRXR)


IEEE ISMAR 2021

Monday, October 4

Overview

The 1st workshop on Replication in Extended Reality aims at bringing together researchers interested in replication of empirical research as well as algorithmic reproducibility inside and outside of the AR/VR/MR/XR community. Specifically, the workshop will start with introducing important concepts and case studies and then evolve into discussing position papers by participants.

Themes of the Workshop

  • Discuss the replication crisis in empirical science and its implications for experiments in extended reality.

  • Raising community awareness about the issues of replication and reproducibility.

  • Identify ways that the community could respond to the replication crisis.

  • Providing a platform for abstracts dealing with replication and reproducibility in extended reality.

Call for Participation [CLICK HERE]

Important Dates:

  • Paper Submission Deadline: August 7th, 2021 AoE (Anywhere on Earth)

  • Paper Notification: August 12th, 2021

  • Camera-Ready Submission Deadline: August 19, 2021 AoE (Anywhere on Earth)

Schedule

The workshop is planned as a half-day event. The tutorial sessions will be interleaved with discussion sessions as well as community-building sessions. The workshop will be held fully virtual. Participants will be able to join via video conference (Zoom).

14:30 - 14:40 (Bari, Italy - CEST GMT +2)

(7:30 - 7:40 AM CST UTC−06:00 )

Welcome and organizational remarks

Speaker: Jens Grubert, Coburg University of Applied Sciences and Arts, Germany

Duration: 10 minutes

14:40 - 15:55 (Bari, Italy - CEST GMT +2)

(7:40 - 8:55 AM CST UTC−06:00 )

Tutorial: The replication crisis, reproducibility and inferential statistics, the reproducibility project in psychology.

Duration: 1 hour 15 minutes, interleaved presentation and discussion.

Speaker: J. Edward Swan II, Mississippi State University, USA

15:55 - 16:25 (Bari, Italy - CEST GMT +2)

(8:55 - 9:25 AM CST UTC−06:00 )

Tutorial: Replication typologies and studies in XR: Current scenario of replication in human-computer interaction, Replication studies in XR research.

Duration: 30 minutes, interleaved presentation and discussion.

Speaker: Mohammed Safayet Arefin, Mississippi State University, USA

16:25 - 16:45 (Bari, Italy - CEST GMT +2)

(9:25 - 9:45 AM CST UTC−06:00 )

Coffee Break in GatherTown

Duration: 20 minutes

16:45 - 17:05 (Bari, Italy - CEST GMT +2)

(9:45 - 10:05 AM CST UTC−06:00 )

Position Paper Presentation

Paper Title: Reducing the Human Factor in Virtual Reality Research to Increase Reproducibility and Replicability

Authors: Daniel Hepperle, Tobias Dienlin, Matthias Wolfel

Duration: 20mins (10 mins presentation + 10 mins discussion)

17:05 - 17:25 (Bari, Italy - CEST GMT +2)

(10:05 - 10:25 AM CST UTC−06:00 )

Position Paper Presentation

Paper Title: Reflections on a Comparative AR Study

Authors: Sven Hoffmann, Florian Jasche, Thomas Ludwig

Duration: 20mins (10 mins presentation + 10 mins discussion)

17:25 - 18:10 (Bari, Italy - CEST GMT +2)

(10:25 - 11:10 AM CST UTC−06:00 )

Tutorial: Replication in HCI and bioinformatics. What can we learn?

Duration: 45 minutes, interleaved presentation and discussion.

Speaker: Florian Echtler, Aalborg University, Denmark

18:10 - 18:30 (Bari, Italy - CEST GMT +2)

(11:10 - 11:30 AM CST UTC−06:00 )

Brainstorming and wrap-up

Reflection about workshop results, identification of next steps (e.g., agenda for supporting replication and reproducibility at ISMAR), wrap-up.

Speaker: Jens Grubert, Coburg University of Applied Sciences and Arts, Germany

Duration: 20 minutes

Organizers

Jens Grubert

Coburg University of Applied Sciences and Arts, Germany

Florian Echtler

Aalborg University, Denmark

Mohammed Safayet Arefin

Mississippi State University, USA

J. Edward Swan II

Mississippi State University, USA