Home

EVENTI is one of the new tasks of the Evalita 2014 Evaluation campaign for NLP and Speech Tools for Italian.

The purpose of EVENTI (EValuation of Events aNd Temporal Information) is to promote research in Temporal Processing for Italian. This evaluation exercise will provide the chance to test a newly developed language resource, the Ita-TimeBank (Caselli et al., 2011) while making it available to the NLP community as one of the largest manually annotated data sets for Temporal Processing.

In addition a pilot task on Temporal Processing of Historical Texts is organized to foster the collaboration between the NLP and the Digital Humanities communities.

Reference to time is a pervasive phenomenon of human communication, and it is reflected in natural language. Recently, a renewed interest in Temporal Processing has spread in the NLP community. The development of the TimeML Annotation Scheme (Pustejovsky et al., 2003), the release of annotated data and the organization of three open evaluation challenges (TempEval-1, TempEval-2 and TempEval-3) have facilitated the development of temporally aware NLP tools. 

Currently, to the best of our knowledge, no complete systems exist for Temporal Processing in Italian, though independent modules for event and temporal expressions processing are available (HeidelTime; Robaldo et al., 2011; Caselli et al., 2011b; Angeli and Uzkoreit, 2013).

In this context, EVENTI wants to promote the development of NLP tools for the extraction of events, temporal expressions and temporal relations from Italian texts.


This task was endorsed by the NewsReader 7th FP Project (ICT-316404).


Updates

  • Results available Evaluation has concluded and reports with system descriptions are being finalised. Congratulations to our participants. You can check the anonymised results under "Results" section.
    Posted Oct 29, 2014, 10:56 AM by Tommaso Caselli
  • Test Data Test data for the EVENTI task have been sent to registered participants. Looking forward to evaluate the system results and good luck!!
    Posted Sep 8, 2014, 8:27 AM by Tommaso Caselli
  • Full Training Data Available We are happy to announce that all training data for the EVENTI task are now available. We have updated the first part (with corrections) and released the second (and final ...
    Posted Jul 29, 2014, 8:55 AM by Tommaso Caselli
  • Scorer Updated!! New version of the official scorer is now available! Downloads from "Data & Tools".
    Posted Jul 10, 2014, 2:50 AM by Tommaso Caselli
  • Scorer Released!! The official scorer for the EVENTI Task @ Evalita 2014 has been released. Download available in "Data & Tools".
    Posted Jun 20, 2014, 7:24 AM by Tommaso Caselli
Showing posts 1 - 5 of 11. View more »

Important Dates

TaskDue DateComplete
Task Guidelines March 15, 2014  
On-line registration opens March 15, 2014  
Development data available May 15, 2014  
Registration closes September 8, 2014  
Test data available September 8, 2014  
Showing 5 items from page Important Dates sorted by Due Date, Complete. View more »