DHP19 Data Format Overview

DHP19 provides the raw DVS recordings in jAER format (.aedat) and the Vicon 3D positions in Matlab format (.mat).

DVS Recordings (DVS_movies folder)

The DVS recordings are arranged in the folder DVS_movies/ according to the following structure:

• S(subject_number)/session(session_number)/mov(movement_number).aedat

Vicon 3D Positions (Vicon_data folder)

DHP19 provides Vicon recordings in Matlab format (.mat), exported using Nexus 2 software (available only for Windows). Each file contains a structure array with 13 fields, one per joint. Each field contains a matrix with dimension [N timesteps , 3 axes], with values expressed in millimeters.

The Vicon 3d positions are arranged in the folder Vicon_data/ according to the following naming:

• S(subject_number)_(session_number)_(movement_number).mat

Projection Matrices (P_matrices folder)

Each camera projection matrix is estimated from point correspondence in the 3D world and 2D image.

The projection matrices are located in the folder P_matrices/ , together with the already calculated camera centers (camera_positions.npy).

In the folder you can find also the corresponding points in 3D and 2D space used for the calibration (Calibration_markers_3D.csv and Calibration_markers_2D.csv). The 3D coordinates were extracted from the Vicon, while the 2D coordinates were manually labled.

DHP19 general info and known issues

DHP19 train and test subjects

We split train and test subjects as follows:

• Training subjects: S1 - S12
• Test subjects: S13 - S17

Missing recordings

Due to technical issues there are 4 missing recordings out of the total 561 (33 movements * 17 subjects):

• S1_4_2
• S4_3_4
• S4_3_6
• S14_5_3