IberLEF 2020

IberLEF 2020: Iberian Languages Evaluation Forum

Accepted Tasks


ALexS 2020: Lexicon Analysis Task at SEPLN

Cantemist 2020: CANcer TExt Mining Shared Task

CAPITEL 2020: Named Entity Recognition and Classification in Spanish News

eHealth-KD 2020: eHealth Knowledge Discovery

FACT 2020: Factuality Analysis and Classification Task

IbeRDI 2020: NLP for R&D&I domain in Spanish: multi-task evaluation of document similarity metrics

IberLegal 2020: NLP for Legal Domain in Spanish: Named Entity Recognition and Classification in Legislative Texts

MEX-A3T 2020: Fake news and offensive language detection in Mexican Spanish

TASS 2020: Sentiment Analysis in Spanish



Call for Task Proposals


The goal of IberLEF is to encourage the research community to organize competitive text processing, understanding and generation tasks with the aim of defining new research challenges and setting new state-of-the-art results for the Natural Language Processing community, involving at least one of the following Iberian languages: Spanish, Portuguese, Catalan, Basque or Galician. IberLEF 2020 is co-located with the SEPLN Conference, which in 2020 will be held in Málaga (Spain) from the 23rd to the 25th of September 2020 as part of CEDI.

Researchers and practitioners from all areas of Natural Language Processing and related communities are invited to submit proposals for evaluation tasks that involve text processing in at least one of the languages spoken in the Iberian Peninsula.

Proposals must be submitted (as a pdf file) to iberlef@googlegroups.com, and should include the following fields:

  • Title of the task.
  • Description of the task, highlighting:
    • Relevance and novelty of the task, and the challenges involved.
    • Evaluation measures and other relevant methodological aspects.
    • Expected target community and actual or potential industrial take up.
    • Related evaluation activities, if any.
    • Previous editions of the task, if any. If it has been organized previously, what is the roadmap and what are the novelties for 2020?
  • Linguistic resources to be gathered, created and/or reused. Please include as many details on data gathering, selection and annotation procedures as possible: sources and representativity, training/validation/test sizes, harvesting procedures, profile of annotators (experts, linguists, crowdworkers, etc.), multiple annotation policy, IPR issues, etc.
  • Tentative schedule (note that camera ready versions of the proceedings must be ready by July 5, 2020).
  • Organization committee: full name and affiliation of the organizers with a succinct description of their research interests, areas of expertise and experience organizing similar events.
  • Funding, if available.
  • Contact person.
  • Any other relevant issues.


Task organisers duties


Note that organizers of accepted tasks are expected to:

  1. Setup the evaluation exercise according to the submitted proposal.
  2. Promote the task within the target research community.
  3. Manage the submission and scientific evaluation of the system description papers of the corresponding systems submitted by the participants. The accepted papers will be published in the IberLEF proceedings.
  4. Prepare and submit an overview of the evaluation exercise for the IberLEF proceedings.
  5. Attend (at least one organizer) IberLEF 2020 in Málaga and present the results of the task.


Task selection procedure


Each submitted proposal will be reviewed by members of the the IberLEF steering and program committee, and decisions will be sent back to the task organizers by December 23, 2019.


Proceedings


IberLEF 2020 Proceedings including description of the tasks and participating systems will be published at CEUR-WS.org. Task organizers are expected to send the camera ready task and system description papers for their task to IberLEF organizers by July 5, 2020.


Important dates


Task proposals due: December 1, 2019.

Notification of acceptance: December 23, 2019.

Camera ready submissions due: July 5, 2020.

IberLEF: September, 2020


IberLEF chairs


Miguel Ángel García Cumbreras, University of Jaén (Spain).

Julio Gonzalo, UNED (Spain).

Eugenio Martínez Cámara, University of Granada (Spain).

Raquel Martínez Unanue, UNED (Spain).

Paolo Rosso, Technical University of Valencia (Spain).


IberLEF Steering Committee

Luis Chiruzzo, Universidad de la República de Uruguay (Uruguay)

Yoan Gutiérrez Vázquez, Universidad de Alicante (Spain)

Salud María Jiménez Zafra, Universidad de Jaén (Spain)

Martin Krallinger, Barcelona Supercomputing Center (Spain)

Daniela Moctezuma, CONACYT (México)

Manuel Montes y Gómez, INAOE (México)

Francisco Rangel Pardo, Symanto (Germany/Spain)

Aiala Rosa, Universidad de la República de Uruguay (Uruguay)

Renata Vieira, PUCRS (Brazil)


IberLEF Program Committee


  • Eneko Agirre (UPV-EHU Donostia-San Sebastián, Spain)
  • César Antonio Aguilar (UC Santiago, Chile)
  • Doaa Ahmed Samy (MINETAD Madrid, Spain)
  • Enrique Amigó (UNED Madrid, Spain)
  • Mikhail Alexandrov (RPANEPA Moscow, Russia)
  • Rodrigo Alfaro Arancibia (UCV Valparaiso, Chile)
  • Victoria Arranz (ELDA/ELRA Paris, France)
  • Javier Artiles (SmartNews Palo Alto, U.S.A.)
  • Alexandra Balahur (EC-JRC Varese, Italy)
  • Rafael Banchs (Ins. Infocomm Research, Singapore)
  • Alberto Barron-Cedeno (QCRI, Qatar)
  • Nuria Bel (UPF Barcelona, Spain)
  • Rafael Berlanga (UJI Castellón, Spain)
  • Davide Buscaldi (Univ-paris13 Villetaneuse, France)
  • Xavier Carreras (NAVER LABS Meylan, France)
  • Noa Cruz Díaz, Savana Médica (Madrid)
  • Marcelo Errecalde (UNSL San Luis, Argentina)
  • Miguel Ángel García Cumbreras (UJA Jaén, Spain)
  • Xavier Gómez Guinovart (UVIGO Vigo, Spain)
  • Fabio A. Gonzalez (UNAL Bogota, Colombia)
  • Antonio Jimeno (IBM Melbourne, Australia)
  • David Losada (USC Santiago de Compostela, Spain)
  • Paloma Martínez (UC3M Leganés, Spain)
  • Patricio Martínez (UA Alicante, Spain)
  • José Eladio Medina (CENATAV Habana, Cuba)
  • Diego Molla-Aliod (MQU Sydney, Australia)
  • Soto Montalvo (URJC Móstoles, Spain)
  • Roser Morante, VU University Amsterdam
  • Viviane Moreira (UFRGS Porto Alegre, Brazil)
  • Lluis Padró (UPC Barcelona, Spain)
  • Ferrán Pla (UPV Valencia, Spain)
  • David Pinto (BUAP Puebla, Mexico)
  • Jordi Porta (RAE Madrid, Spain)
  • Paulo Quaresma (UE Evora, Portugal)
  • German Rigau (UPV-EHU Donostia-San Sebastián, Spain)
  • Horacio Saggion (UPF Barcelona, Spain)
  • Marc-Franco Salvador (Symanto Valencia, Spain)
  • Eric San Juan (IUT STID Avignon, France)
  • Grigori Sidorov (IPN Mexico City, Mexico)
  • Thamar Solorio (UH Houston, U.S.A.)
  • Mariona Taulé (UB Barcelona, Spain)
  • Javier Tejada (UCSP Arequipa, Peru)
  • José Antonio Troyano (US Sevilla, Spain)
  • Luis Alfonso Ureña (UJA Jaén, Spain)
  • Antonio Valderrábanos (Bitext Madrid, Spain)
  • Rafael Valencia (UM Murcia, Spain)
  • Juan Velasquez (UCHILE Santiago, Chile)
  • Jesús Vilares (UDC A Coruña, Spain)
  • Manuel Vilares (UVIGO Vigo, Spain)
  • Julio Villena (MeaningCloud Madrid, Spain)
  • Dina Wonsever (UDELAR Montevideo, Uruguay)