Embedded Files
OmniLabel benchmark: Novel dataset with complex, free-form text descriptions of objects. Checkout https://www.omnilabel.org and https://arxiv.org/abs/2304.11463 for details
Train on public datasets and evaluate on our benchmark! We define two tracks to compete, which differ in the allowed training data.
Validation set for the OmniLabel challenge 2024 is available (v0.1.4). Use our evaluation servers (Track A, Track B) to test your model on the validation set and participate in the challenge. Use our toolkit to evaluate a model on the validation set by yourself.
Evaluation servers
Evaluation servers
Track A: https://codalab.lisn.upsaclay.fr/competitions/19200
Track B: https://codalab.lisn.upsaclay.fr/competitions/19201
Checkout the definition for each track on https://www.omnilabel.org/task
Timeline
Timeline
05/29/2024 - Public release of updated benchmark validation set. Evaluation server goes online and accepts submissions on val set.
07/12/2024 08/16/2024 - Test set release - evaluation server accepts submissions on the test set
07/26/2024 08/23/2024 - Challenge closes
08/02/2024 08/28/2024 - Deadline for submitting report (all challenge participants are required to provide a brief report about their method)
08/09/2024 08/28/2024 - Challenge winners will be informed
09/29/2024 - Workshop at ECCV 2024 (half-day)
Page updated
Google Sites
Report abuse