As illustrated in the above diagram, the participants conducted the eight tasks (from Task A to H). This study was designed as a 2 x 2 x 2 within-subject study. This user experiment was reviewed and approved by the Purdue University Institutional Review Board (IRB) (#IRB-2021-1813).  The experiments were conducted by following below prcedures:

1. Fill out an informed consent and a demographic questionnaire 

2. Wear two wearable biosensors

3. Known instructions for each of the nine tasks (one training and eight main experiment tasks)

4. Perform a trial CCTV mission with three self-reporting questionaries (ISA, NASA-TLX, and SAM) 

• to familiarize themselves with the experiment hardware and to understand the CCTV monitoring tasks used in this experiment.

5. Start the main experiment with one of eight tasks with different workload allocation methods (see below table)

• Each task consisted of three sets (total 300 seconds) and three break times (total 60 seconds)

  • • • Task A*, B*, and F: break times (10 sec) + break times (10 sec)

      • Task C* and G: ISA session (IS) (10 sec) + Approval session(10 sec)

      • Task D* and H: ISA session (IS)  (10 sec) + break times (10 sec)

      • Task E: break times (10 sec) + Approval session(10 sec)

*Task A, B, C, and D: not including the results of affective prediction model (APM)

6. After completing each task, participants were asked to evaluate their emotional and cognitive states using questionnaires via the GUI programs.

• Self-assessment manikin (SAM): measuring emotional states (arousal and valence)

• Instantaneous Self-Assessment (ISA)

• NASA task load index (NASA-TLX)

At the end of the user experiment, participants were interviewed for approximately 5 minutes to gain insight into their overall experience with our MH-MR AWAC system. 

The interview began with a lead-off question 

• "Did you notice any differences between the eight sessions? If so, what were they?"

• "What are your thoughts on the ISA and Approval sessions during the mission?"

• "Which method do you prefer for conducting this CCTV monitoring task: changing or fixed workloads?"

Here is a supplementary video recorded during one of our experiments. This video explains the entire procedure of our team-based user experiment. It will help you understand the design of our team-based user experiment.