Publications
2024
ELOQUENT CLEF Shared Tasks for Evaluation of Generative Language Model Quality [pdf]
Jussi Karlgren, Luise Dürlich, Evangelia Gogoulou, Liane Guillou, Joakim Nivre, Magnus Sahlgren, Aarne Talman. ECIR 2024. Glasgow, United Kingdom. 24-28 March 2024.
Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets [pdf]
Nikita Moghe, Arnisa Fazla, Chantal Amrhein, Tom Kocmi, Mark Steedman, Alexandra Birch, Rico Sennrich, Liane Guillou. arXiv, 29 January 2024.
2023
ACES: Translation Accuracy Sets at WMT 2023 [pdf] [data] [code]
Chantal Amrhein, Nikita Moghe, and Liane Guillou. WMT 2023. Singapore. 6-7 December 2023.
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue [pdf] [bib]
Nikita Moghe, Evgeniia Razumovskaia, Liane Guillou, Ivan Vulić, Anna Korhonen, and Alexandra Birch. Findings of ACL 2023; presented at NLP4ConvAI.
2022
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics [pdf] [bib] [data] [code]
Chantal Amrhein, Nikita Moghe, and Liane Guillou. WMT 2022. Abu Dhabi, United Arab Emirates. 7-8 December 2022.
Integrating Paraphrasing into the FRANK QA System [pdf]
Nick Ferguson, Liane Guillou, Kwabena Nuamah, and Alan Bundy. HLC 2022. Windsor, United Kingdom. 28-30 September 2022.
Cross-lingual Inference with A Chinese Entailment Graph [pdf] [bib]
Tianyi Li, Sabine Webber, Mohammad Javad Hosseini, Liane Guillou, and Mark Steedman. ACL 2022. Dublin, Ireland and Online. 22-27 May 2022.
Investigating the use of Paraphrase Generation for Question Reformulation in the FRANK QA System [pdf]
Nick Ferguson, Liane Guillou, Kwabena Nuamah, and Alan Bundy. arXiv, 6 June 2022. (Nick Ferguson's first year CDT PhD project report)
2021
Blindness to Modality Helps Entailment Graph Mining [pdf] [bib]
Liane Guillou, Sander Bijl de Vroe, Mark Johnson, and Mark Steedman. Insights 2021. Punta Cana, Dominican Republic and Online. 10 November 2021.
Multivalent Entailment Graphs for Question Answering [pdf] [bib]
Nick McKenna, Liane Guillou, Mohammad Javad Hosseini, Sander Bijl de Vroe, Mark Johnson, and Mark Steedman. EMNLP 2021. Punta Cana, Dominican Republic and Online. 7-11 November 2021.
Modality and Negation in Event Extraction [pdf] [bib] [code]
Sander Bijl De Vroe, Liane Guillou, Milos Stanojevic, Nick McKenna, and Mark Steedman. CASE 2021. Online, 5-6 August 2020.
2020
Incorporating Temporal Information in Entailment Graph Mining [pdf] [bib] [video]
Liane Guillou, Sander Bijl De Vroe, Javad Hosseini, Mark Johnson and Mark Steedman. TextGraphs 2020. Barcelona, Spain, 13 December 2020.
2018
A Pronoun Test Suite Evaluation of the English-German MT Systems at WMT 2018 [pdf] [bib]
Liane Guillou, Christian Hardmeier, Ekaterina Lapshinova-Koltunski and Sharid Loáiciga. WMT 2018. Brussels, Belgium, 31 October - 1 November 2018.
Automatic Reference-Based Evaluation of Pronoun Translation Misses the Point [pdf] [bib]
Liane Guillou and Christian Hardmeier. EMNLP 2018. Brussels, Belgium, 31 October - 4 November 2018.
Pronoun Translation in English-French Machine Translation: An Analysis of Error Types [pdf] [bib]
Christian Hardmeier and Liane Guillou. arXiv, 30 August 2018.
2017
What is it? Disambiguating the different readings of the pronoun ‘it’ [pdf] [bib]
Sharid Loáiciga, Liane Guillou, and Christian Hardmeier. EMNLP 2017. Copenhagen, Denmark. 7-11 September 2017.
2016
PhD Thesis: Incorporating Pronoun Function into Statistical Machine Translation [pdf] [pre-viva talk slides]
Liane Guillou. School of Informatics. University of Edinburgh. 2016.
It-disambiguation and Source-aware Language Models for Cross-lingual Pronoun Prediction [pdf]
Sharid Loáiciga, Liane Guillou and Christian Hardmeier. SLTC 2016. Umeå University, Sweden. 17-18 November 2016.
Findings of the 2016 WMT Shared Task on Cross-lingual Pronoun Prediction [pdf] [bib] [slides]
Liane Guillou, Christian Hardmeier, Preslav Nakov, Sara Stymne, Jörg Tiedemann, Yannick Versley, Mauro Cettolo, Bonnie Webber and Andrei Popescu-Belis. WMT 2016. Berlin, Germany. 11-12 August 2016.
It-disambiguation and Source-aware Language Models for Cross-lingual Pronoun Prediction [pdf] [bib]
Sharid Loáiciga, Liane Guillou and Christian Hardmeier. WMT 2016. Berlin, Germany. 11-12 August 2016.
A Graphical Pronoun Analysis Tool for the PROTEST Pronoun Evaluation Test Suite [pdf]
Christian Hardmeier and Liane Guillou. EAMT 2016. Riga, Latvia. 30 May - 1 June 2016.
PROTEST: A Test Suite for Evaluating Pronouns in Machine Translation [pdf] [bib] [test suite]
Liane Guillou and Christian Hardmeier. LREC 2016. Portoroz, Slovenia. 25-27 May 2016.
2015
Analysing ParCor and its Translations by State-of-the-art SMT Systems [pdf] [bib]
Liane Guillou and Bonnie Webber. DiscoMT 2015. Lisbon, Portugal. 17 September 2015.
Automatic Post-Editing for the DiscoMT Pronoun Translation Task [pdf] [bib]
Liane Guillou. DiscoMT 2015. Lisbon, Portugal. 17 September 2015.
2014
ParCor 1.0: A Parallel Pronoun-Coreference Corpus to Support Statistical MT [pdf] [bib] [poster] [corpus]
Liane Guillou, Christian Hardmeier, Aaron Smith, Jörg Tiedemann and Bonnie Webber. LREC 2014. Reykjavik, Iceland. 26-31 May 2014.
2013
Analysing Lexical Consistency in Translation [pdf] [bib]
Liane Guillou. DiscoMT 2013. Sofia, Bulgaria. 9 August 2013.
2012
Improving Pronoun Translation in Statistical Machine Translation [pdf] [bib]
Liane Guillou. EACL 2012 Student Research Workshop. Avignon, France. 23-27 April 2012.
2011
Masters Thesis: Improving Pronoun Translation in Statistical Machine Translation [pdf]
Liane Guillou. School of Informatics. University of Edinburgh. August 2011.