The SR’18 Shared Task was a new multilingual surface realisation task organised as part of the ACL’18 Workshop on Multilingual Surface Realisation. As in its English-only predecessor task SR’11, the shared task comprised two tracks with different levels of complexity:
a shallow track where the inputs were full UD structures with word order information removed and tokens lemmatised; and
a deep track where additionally, functional words and morphological information were removed.
The shallow track was offered in ten, and the deep track in three languages. Systems were evaluated
automatically, using a range of intrinsic metrics, and
by human judges in terms of readability and meaning similarity.
Surface track languages: Arabic, Czech, Dutch, English, Finnish, French, Italian, Portuguese, Russian and Spanish.
Deep track languages: English, French, Spanish.
More details can be found on the SR'18 webpage.
Shared Task Results:
pdf (v2) bib The First Multilingual Surface Realisation Shared Task (SR’18): Overview and Evaluation Results
[W18-3601]: Simon Mille | Anja Belz | Bernd Bohnet | Yvette Graham | Emily Pitler | Leo Wanner
pdf bib BinLin: A Simple Method of Dependency Tree Linearization
[W18-3602]: Yevgeniy Puzikov | Iryna Gurevych
pdf bib IIT (BHU) Varanasi at MSR-SRST 2018: A Language Model Based Approach for Natural Language Generation
[W18-3603]: Shreyansh Singh | Ayush Sharma | Avi Chawla | A.K. Singh
pdf bib Surface Realization Shared Task 2018 (SR18): The Tilburg University Approach
[W18-3604]: Thiago Castro Ferreira | Sander Wubben | Emiel Krahmer
pdf bib The OSU Realizer for SRST ‘18: Neural Sequence-to-Sequence Inflection and Incremental Locality-Based Linearization
[W18-3605]: David King | Michael White
pdf bib Generating High-Quality Surface Realizations Using Data Augmentation and Factored Sequence Models
[W18-3606]: Henry Elder | Chris Hokamp
pdf bib AX Semantics’ Submission to the Surface Realization Shared Task 2018
[W18-3607]: Andreas Madsack | Johanna Heininger | Nyamsuren Davaasambuu | Vitaliia Voronik | Michael Käufl | Robert Weißgraeber
pdf bib NILC-SWORNEMO at the Surface Realization Shared Task: Exploring Syntax-Based Word Ordering using Neural Models
[W18-3608]: Marco Antonio Sobrevilla Cabezudo | Thiago Pardo
pdf bib The DipInfo-UniTo system for SRST 2018
[W18-3609]: Valerio Basile | Alessandro Mazzei