Task Results

Results

Here's the ranking of systems submitted by participants. Performances are evaluated in terms of accuracy over the test set.

Settings Results:

Raw features setting (RF) in an in--domain scenario:

Raw features setting (RF) in a cross--domain scenario:

Raw and structured features setting (RnS) in an in--domain scenario:

Raw and structured features setting (RnS) in an cross--domain scenario:

More details about each model and the results can be found in the technical report of PRELEARN shared task:

  • Alzetta C., Miaschi A., Dell’Orletta F., Koceva F., Torre I. (2020) “PRELEARN@EVALITA 2020: Overview of the Prerequisite Relation Learning Task for Italian”. In Proceedings of EVALITA ’20, Evaluation of NLP and Speech Tools for Italian, 16-17 December, Online, Italy.