The SR’20 Shared Task was the third edition of the multilingual surface realisation task organised as part of the COLING’20 Workshop on Multilingual Surface Realisation. As in its predecessor tasks SR’11, SR’18 and SR’19, the shared task comprised two tracks with different levels of complexity:
a shallow track where the inputs were full UD structures with word order information removed and tokens lemmatised; and
a deep track where additionally, functional words and morphological information were removed.
The shallow track was offered in eleven, and the deep track in three languages. Systems were evaluated
automatically, using a range of intrinsic metrics, and
by human judges in terms of readability and meaning similarity.
The 2020 task was run using the same data as in the 2019 task, but with new additional test sets.
Surface track languages: Arabic, Chinese, English, French, Hindi, Indonesian, Japanese, Korean, Portuguese, Russian and Spanish.
Deep track languages: English, French, Spanish.
More details can be found on the SR'20 webpage.
Simon Mille, Anya Belz, Bernd Bohnet, Thiago Castro Ferreira, Yvette Graham, and Leo Wanner. 2020. The Third Multilingual Surface Realisation Shared Task (SR’20): Overview and Evaluation Results. In Proceedings of the Third Workshop on Multilingual Surface Realisation, pages 1–20, Barcelona, Spain (Online). Association for Computational Linguistics.
Henry Elder. 2020. ADAPT at SR’20: How Preprocessing and Data Augmentation Help to Improve Surface Realization. In Proceedings of the Third Workshop on Multilingual Surface Realisation, pages 30–34, Barcelona, Spain (Online). Association for Computational Linguistics.
Farhood Farahnak, Laya Rafiee, Leila Kosseim, and Thomas Fevens. 2020. Surface Realization Using Pretrained Language Models. In Proceedings of the Third Workshop on Multilingual Surface Realisation, pages 57–63, Barcelona, Spain (Online). Association for Computational Linguistics.
Gábor Recski, Ádám Kovács, Kinga Gémes, Judit Ács, and Andras Kornai. 2020. BME-TUW at SR’20: Lexical grammar induction for surface realization. In Proceedings of the Third Workshop on Multilingual Surface Realisation, pages 21–29, Barcelona, Spain (Online). Association for Computational Linguistics.
Marco Antonio Sobrevilla Cabezudo and Thiago Pardo. 2020. NILC at SR’20: Exploring Pre-Trained Models in Surface Realisation. In Proceedings of the Third Workshop on Multilingual Surface Realisation, pages 50–56, Barcelona, Spain (Online). Association for Computational Linguistics.
Xiang Yu, Simon Tannert, Ngoc Thang Vu, and Jonas Kuhn. 2020. IMSurReal Too: IMS in the Surface Realization Shared Task 2020. In Proceedings of the Third Workshop on Multilingual Surface Realisation, pages 35–41, Barcelona, Spain (Online). Association for Computational Linguistics.