Evaluation

Evaluation rules

Submissions will be evaluated on the test partition of the DA-VINCIS Corpus. Macro Precision, Recall and F1 measure scores will be reported for subtask 2, and the corresponding measures with respect to the class of interest (i.e., violent event) will be considered for subtask 1. In both cases, the leading evaluation measure will be the F1-score.

"Participants are allowed to submit up to five runs for each track. The participants must clearly flag each of the runs."

Paper Submission

Participants of the tasks will be given the opportunity to write a paper describing their system, resources used, results, and analysis. It will be part of the official IberLEF-2023 proceedings. System description papers should be formatted according to the Springer Conference Proceedings style. Latex and Word templates can be found there. The minimum length of a regular paper should be 5 pages. There is no maximum page limit.

Papers must be written in English.