Supported Workshop Dataset

Although authors may use any datasets they choose in their submissions, the organizers are also providing a dataset of 14 Creative Commons license movies, particularly useful for the challenge track of this workshop. Full ground truth as annotated by human annotators will be released for these movies which can be used by systems as a training set.

If you make use of the dataset or otherwise participate in the workshop please cite this paper using the following bibtex:

@inproceedings{curtis2020hlvu,

title={HLVU: A New Challenge to Test Deep Understanding of Movies the Way Humans do},

author={Curtis, Keith and Awad, George and Rajput, Shahzad and Soboroff, Ian},

booktitle={Proceedings of the 2020 International Conference on Multimedia Retrieval},

pages={355--361},

year={2020}

}

Movie Dataset

The full Deep Video Understanding training set of 14 movies and total duration of about 17 hr is available from this link. This dataset comprises 14 movies with a Creative Commons license which can be used for conducting experimental research for submissions to this workshop. This training set has been annotated by human assessors and final ground truth, both at the overall movie level (Ontology of relations, entities, actions & events, Knowledge Graph, and names and images of all main characters), and the individual scene level (Ontology of locations, people/entities, interactions and their order between people, sentiments, and text summary) has been be provided for the training set to participating researchers for training and development of their systems. More information about movies' genres and duration are provided:

  1. Honey - Romance - 86 mins.

  2. Let's bring back Sophie - Drama - 50 mins.

  3. Nuclear Family - Drama - 28 mins.

  4. Shooters - Drama - 41 mins.

  5. Spiritual Contact The Movie - Fantasy - 66 mins.

  6. Super Hero - Fantasy - 18 mins.

  7. The Adventures of Huckleberry Finn - Adventure - 106 mins.

  8. The Big Something - Comedy - 101 mins.

  9. Time Expired - Comedy / Drama - 92 mins.

  10. Valkaama - Adventure - 93 mins.

  11. Bagman - Drama / Thriller - 107 mins.

  12. Manos - Horror - 73 mins.

  13. Road to Bali - Comedy / Musical - 90 mins.

  14. The Illusionist - Adventure / Drama - 109 mins.