2nd Workshop on Replication in Extended Reality (WoRXR)

Overview

The "replication crisis" describes widespread failures to replicate empirical findings. Over 50% of previously reported results could not be replicated in many cases. While originating in medicine and psychology, the replication crisis has also reached other empirical research areas such as computer science. These issues have shaken the foundations of these fields: Can empirical results be believed? How can we support the reproducibility of increasingly complex interactive systems?

We invite researchers to conduct replication studies of their own (or others') previous experiments with a new set of participants. We anticipate that the current trend towards XR-based studies using, e.g., Quest or HoloLens, will make it easier to re-run existing experiments. One goal of the workshop is to work towards a joint journal submission on lessons learned through the replicated studies.

This workshop aims to bring together researchers interested in the replication of empirical research and algorithmic reproducibility of computing artifacts inside and outside of the AR/VR/MR/XR community. Specifically, the workshop will start with introducing important concepts and case studies and then evolve into discussing position papers by participants.

Topics of Interest

Key topics of the workshop include, but are not limited to:

• position papers on replication/reproduction and their relation to the XR community.

• papers describing (successful or attempted) replication of existing works.

• meta-analyses on the feasibility of replication in mixed reality.

• algorithmic reproducibility of technical systems (hardware, software, demonstrators, ...).

• experiences from your own laboratory's efforts to replicate existing empirical studies or reproduce technical systems and to publish those findings.

• proposals for improving reproducibility at ISMAR (and related venues).

Important Dates

• Paper Submission Deadline: August 1st, 2022(AOE) August 8th, 2022

• Paper Notification: August 8th, 2022 August 15th, 2022

• Camera-Ready Submission Deadline: August 31st, 2022

• Workshop: October 17th, 2022

Contact Information

• Email: You can contact any of the organizers with any specific questions related to the workshop and submission.

Jens Grubert == jens.grubert@hs-coburg.de

Florian Echtler == floech@cs.aau.dk

Verena Biener == verena.biener@hs-coburg.de

Mohammed Safayet Arefin == arefin@acm.org

J. Edward Swan II == swan@acm.org

Submission Information

• Attendees who wish may contribute an abstract of up to two pages, similar in format to a poster abstract using the VGTC conference paper template.

• Longer position papers will also be considered. These will be selected by the organizers based on fitting the workshop's topic. All submitted longer papers must be prepared using the VGTC conference paper template.

Submission Process:

Please kindly send your submission to these email addresses - arefin@acm.org and verena.biener@hs-coburg.de

All accepted abstracts and longer papers will be included as IEEE ISMAR Adjunct Proceedings in the IEEE Xplore Digital Library.

** Attendees are also welcome to discuss their experiences with replication issues without submitting a paper **