DHP19

Dynamic Vision Sensor 3D Human Pose Dataset

Welcome to DHP19!

This is the website of the Dynamic Vision Sensor (DVS) 3D Human Pose Dataset.


DHP19 was developed by the Sensors Group of the Inst. of Neuroinformatics, Univ. of Zurich and ETH Zurich.

Information about other datasets and tools are on the Sensors Group webpage.

Contact

For questions related to DHP19, contact Enrico Calabrese (enrico@ini.uzh.ch), Gemma Taverni (getaverni@ini.uzh.ch), and Tobi Delbruck (tobi@ini.uzh.ch) , Sensors Group, Institute of Neuroinformatics, University and ETH Zurich, Switzerland.

Introduction

DHP19 is the first human pose dataset with data collected from DVS event cameras.

It has recordings from 4 synchronized 346x260 pixel DVS cameras and marker positions in 3D space from Vicon motion capture system. The files have event streams and 3D positions recorded from 17 subjects each performing 33 movements.

It also includes a reference Convolutional Network implementation for instantaneous human pose estimation, trained on DVS constant-count frames from the two frontal DVS cameras.

Examples of DVS recordings and Vicon 3D labels.

Overview

See this video for introduction to the datatset

dhp19_video_final_.mp4

Citation

If you use DHP19, please cite the following paper:


Bibtex

@InProceedings{Calabrese_2019_CVPR_Workshops,author = {Calabrese, Enrico and Taverni, Gemma and Awai Easthope, Christopher and Skriabine, Sophie and Corradi, Federico and Longinotti, Luca and Eng, Kynan and Delbruck, Tobi},title = {DHP19: Dynamic Vision Sensor 3D Human Pose Dataset},booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},month = {June},year = {2019}}

Prior work

DHP19 was collected with DAVIS 346 cameras. The seminal citations for this sensor are:

  • Brandli, C., Berner, R., Yang, M., Liu, S.-C., and Delbruck, T. (2014). A 240x180 130 dB 3 us Latency Global Shutter Spatiotemporal Vision Sensor. IEEE Journal of Solid-State Circuits 49, 2333–2341. doi:10.1109/JSSC.2014.2342715.
  • Lichtsteiner, P., Posch, C., and Delbruck, T. (2008). A 128x128 120dB 15us Latency Asynchronous Temporal Contrast Vision Sensor. IEEE Journal of Solid-State Circuits 43, 566–576. doi:10.1109/JSSC.2007.914337.
Calabrese_DHP19_Dynamic_Vision_Sensor_3D_Human_Pose_Dataset_CVPRW_2019_paper.pdf