Large Scale Movie Description Challenge (LSMDC) 2021
Submission servers are open!
Tasks
Following 2019, we continue the latest challenge tracks, aiming at a more realistic and practical setting of multi-sentence movie description generation. Specifically, movie descriptions are evaluated on sets of 5 clips, rather than on individual clips. When describing sequences of events, it becomes important to distinguish "who is who" in order to provide a coherent and informative narrative. Thus, the challenge will have a focus on identifying characters, rather than predicting generic "SOMEONE"-s in place of all the occurring character names. The challenge is split in three tasks:
the 1st task still asks to generate descriptions with "SOMEONE"-s but the evaluation is carried out on sets of 5 clips,
the 2nd task focuses on filling-in the character IDs locally (within a set of 5 clips), while the rest of each description is available,
the 3rd task combines both description generation and filling-in the local character IDs for the sets of 5 clips.
More details are provided here and the corresponding annotations are available for download here.
Important dates
Challenge submission deadlines
Task 1 "Multi-Sentence Description": Oct 1, 2021
Task 2 "Fill-in the Characters": Oct 8, 2021
Task 3 "Multi-Sentence Description with Characters": Oct 1, 2021
Workshop: Monday, Oct 17 (full day)
Contact
lsmdc2015+21 at gmail.com
Organizers
Anna Rohrbach, Research Scientist at UC Berkeley
Jae Sung Park, PhD student at University of Washington
Sponsors
TBD