Groups were given three questionnaires over the course of the experiment:
A pre-study questionnaire given immediately after being briefed on the nature of the experiment
A mid-study questionnaire given between DT3 and FET. This was accompanied by a 5 minute break
A post-study questionnaire given after FET at the end of the experiment
Participants were not allowed to discuss amongst each other while answering the questionnaires to minimise bias, but where allowed to ask the experimenters about specific questions if they were unsure what they meant. Likert scales were given in the range 1 (disagree) to 5 (agree).
The de-identified questionnaire results for both study parts can be found here.
The questions given in each questionnaire were as follows. Likert-scale questions are marked with an asterisk (*).
The pre-study questionnaire asked demographics-based questions about each participant.
What is your gender?
What is your age?
What is your level of education?
What is your main area of expertise/specialisation?
* How familiar are you with virtual reality technology?
* How familiar are you with data visualisation?
* How familiar are you with data analysis?
* How often do you work in collaborative settings?
* How well do you know the other participants?
The mid-study questionnaire focused on how participants collaborated and the strategy which they used during DT1, DT2 and DT3.
Collaboration
* I frequently communicated with the rest of my team
* I openly shared all relevant information
* I felt part of a team when completing the tasks
* I worked closely with my team members
* We explicitly discussed how to best complete the tasks as a team
* I was aware of what my team members were doing at all times
* I feel each one of us contributed equally
* I felt it was necessary to work as a team to complete the tasks
* I often felt distracted/annoyed by my team members' actions
Strategy
Describe the strategy your team used to solve the tasks.
Did this strategy change over time? How?
How was the work distributed and how was this decided?
How was the workspace divided/shared among the group?
Was there one person who led the team? If so, who and how was this determined?
Did being in virtual reality help or hinder your collaboration? How?
The post-study questionnaire focused on how participants collaborated and the strategy which they used during FET. It also asked questions about overall system usability, presence, and cybersickness in VR.
Collaboration
* I frequently communicated with the rest of my team
* I openly shared all relevant information
* I felt part of a team when completing the tasks
* I worked closely with my team members
* We explicitly discussed how to best complete the tasks as a team
* I was aware of what my team members were doing at all times
* I feel each one of us contributed equally
* I felt it was necessary to work as a team to complete the tasks
* I often felt distracted/annoyed by my team members' actions
Virtual Reality
* I felt comfortable using the virtual reality setup
* I felt that I was really immersed in the virtual environment
* I felt sick during the study
* I felt that the other participants were really there with me inside the virtual environment
* I felt comfortable talking to the other participants while in virtual reality
* I felt that my point of view was acknowledged by other participants in virtual reality
* Discussions using the virtual reality setup felt more impersonal than real world face-to-face discussions
Strategy
Describe the strategy your team used to solve the tasks.
Did this strategy change over time? How?
How was the work distributed and how was this decided?
How was the workspace divided/shared among the group?
Was there one person who led the team? If so, who and how was this determined?
Did being in virtual reality help or hinder your collaboration? How?
System Functionality
Are there any missing features and/or changes that would help the visual analytics process? If so, please explain.
Are there any missing features and/or changes that would help with collaboration? If so, please explain.