3rd Workshop on Replication in Extended Reality (WoRXR)

Overview

The "replication crisis" describes widespread failures to replicate empirical findings. Over 50% of previously reported results could only be replicated in a few cases. While originating in medicine and psychology, the replication crisis has also reached other empirical research areas, such as computer science. These issues have shaken the foundations of these fields: Can empirical results be believed? How can we support the reproducibility of increasingly complex interactive systems?

We invite researchers to conduct replication studies of their own (or other's) previous experiments with a new set of participants. We anticipate that the current trend towards XR-based studies using, e.g., Quest or HoloLens, will make it easier to re-run existing experiments. One workshop goal is to work towards a joint journal submission on lessons learned through replicated studies.

This workshop aims to bring together researchers interested in replicating empirical research and algorithmic reproducibility of computing artifacts inside and outside the AR/VR/MR/XR community. Specifically, the workshop will introduce essential concepts and case studies and then evolve into discussing position papers by participants.

All accepted abstracts, and longer papers will be included as IEEE ISMAR  Adjunct Proceedings in the IEEE Xplore Digital Library. 

Attendees are also welcome to discuss their experiences with replication issues without submitting a paper.

Topics of Interest

Key topics of the workshop include, but are not limited to:

• position papers on replication/reproduction and their relation to the XR community.

• papers describing (successful or attempted) replication of existing works.

• meta-analyses on the feasibility of replication in mixed reality.

• algorithmic reproducibility of technical systems (hardware, software, demonstrators, ...).

• experiences from your laboratory's efforts to replicate existing empirical studies or reproduce technical systems and publish those findings.

• proposals for improving reproducibility at ISMAR (and related venues).

Important Dates

• Paper Submission Deadline: July 23, 2023 (Sunday) August 1st, 2023, 23:59 AoE (extended)

• Acceptance Notification: August 7th, 2023 (Monday)

• Camera-Ready Submission Deadline:  August 21st, 2023 (Monday)  

Contact Information:

 Email - worxr.organizers@gmail.com

Submission Information

• Attendees who wish may contribute an abstract of up to two pages, similar in format to a poster abstract, using the VGTC conference paper template.

• Longer position papers will also be considered. The organizers will select these based on fitting the workshop's topic and merit. All submitted longer papers must be prepared using the VGTC conference paper template.

Submission process:

• The peer-review process is single-blind (the identities of the reviewers are not known to the authors, but the reviewers know the identities of the authors).

• Please kindly send your submission directly to this email address - worxr.organizers@gmail.com