Publications

Preprints 

see ArXiv for a complete list 

1. Laura Weidinger, Maribeth Rauh, Nahema Marchal, Arianna Manzini, Lisa Anne Hendricks, Juan Mateos-Garcia, Stevie Bergman, Jackie Kay, Conor Griffin, Ben Bariach, Iason Gabriel, Verena Rieser, William Isaac. Sociotechnical Safety Evaluation of Generative AI Systems. arXiv:2310.11986 (2023)

2. Marco Casadio, Luca Arnaboldi, Matthew L. Daggitt, Omri Isac, Tanvi Dinkar, Daniel Kienitz,  Verena Rieser, Ekaterina Komendantskaya. ANTONIO: Towards a Systematic Method of Generating NLP Benchmarks for Verification. arXiv preprint arXiv:2305.04003 (2023) 

3. Gavin Abercrombie,  Verena Rieser, Dirk Hovy. Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement. 2023.

4. Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilić, Daniel Hesslow, Roman Castagné,  Verena Rieser}et al. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. arXiv preprint arXiv:2211.05100 (2022).  BigScience Large Open-science Open-access Multilingual Language Model (BLOOM)

5.  Alessandro Suglia, José Lopes, Emanuele Bastianelli, Andrea Vanzo, Shubham Agarwal, Malvina Nikandrou, Lu Yu, Ioannis Konstas, and Verena Rieser. "Going for GOAL: A Resource for Grounded Football Commentaries." arXiv preprint arXiv:2211.04534 (2022).

6. Mavina Nikandrou, Lu Yu, Alessandro Suglia, Ioannis Konstas, Verena Rieser. Task Formulation Matters When Learning Continually: A Case Study in Visual Question Answering. ArXiv preprint 

2024

1. Arianna Manzini, Geoff Keeling, Nahema Marchal, Kevin R. McKee, Verena Rieser, Iason Gabriel. Should Users Trust Advanced AI Assistants? Justified Trust As a Function ofCompetence and Alignment. ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT 2024) 

2023

1. Gavin Abercrombie, Amanda Cercas Curry, Tanvi Dinkar, Verena Rieser and Zeerak Talat. Mirages: On Anthropomorphism in Dialogue Systems. The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) Arxiv

2. Georgios Pantazopoulos, Malvina Nikandrou, Amit Parekh, Bhathiya Hemanthage, Arash Eshghi, Ioannis Konstas, Verena Rieser, Oliver Lemon, Alessandro Suglia. Multitask Multimodal Prompted Training for Interactive Embodied Task Completion. The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023) (=  system description of our finalist entrance to the Amazon SimBot challenge 2023)

3. Lu Yu and Verena Rieser. Adversarial Robustness of Visual Dialog. Findings of ACL 2023 ArXiv preprint PDF

4. Sabrina Chiesurin, Dimitris Dimakopoulos, Marco Antonio Sobrevilla Cabezudo, Arash Eshghi, Ioannis Papaioannou, Verena Rieser and Ioannis Konstas. The Dangers of trusting Stochastic Parrots: Faithfulness and Trust in Open-domain Conversational  Question Answering. Findings of ACL 2023

5. Lu Yu, Malvina Nikandrou, Jiali Jin, and Verena Rieser. Quality-agnostic Image Captioning to Safely Assist People with Vision Impairment.  32nd International Joint Conference on Artificial Intelligence. IJCAI-23 Special session AI for Social Good, 2023. PDF

6. Neeraj Cherakara, Finny Varghese, Sheena Shabana, Nivan Nelson, Abhiram Karukayil, Rohith Kulothungan, Mohammed Afil Farhan, Birthe Nesset, Meriam Moujahid, Tanvi Dinkar, Verena Rieser and Oliver Lemon. FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions. 24th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2023). (Class project by MSc students)

7. Anya Belz, Craig Thomson, Ehud Reiter, Gavin Abercrombie, Jose M. Alonso-Moral, Mohammad Arvan, Jackie Cheung, Mark Cieliebak, Elizabeth Clark, Kees van Deemter, Tanvi Dinkar, Ondřej Dušek, Steffen Eger, Qixiang Fang, Albert Gatt, Dimitra Gkatzia, Javier González-Corbelle, Dirk Hovy, Manuela Hürlimann, Takumi Ito, John D. Kelleher, Filip Klubicka, Huiyuan Lai, Chris van der Lee, Emiel van Miltenburg, Yiru Li, Saad Mahamood, Margot Mieskes, Malvina Nissim, Natalie Parde, Ondřej Plátek, Verena Rieser, Pablo Mosteiro Romero, Joel Tetreault, Antonio Toral, Xiaojun Wan, Leo Wanner, Lewis Watson, Diyi Yang. Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP. To appear at "Workshop on Insights from Negative Results in NLP" (co-located with EACL2023)  preprint

8. Nikolas Vitsakis, Amit Parekh, Tanvi Dinkar, Gavin Abercrombie, Ioannis Konstas and Verena Rieser. iLab at SemEval-2023 Task 11 Le-Wi-Di: Modelling Disagreement or Modelling Perspectives? SemEval 2023 Preprint

9. Elisa Leonardelli, Gavin Abercrombie, Dina Almanea, Valerio Basile, Tommaso Fornaciari, Barbara Plank, Verena Rieser, Alexandra Uma and Massimo Poesio. SemEval-2023 Task 11: Learning With Disagreements (Le-Wi-Di). SemEval 2023 preprint

2022

1. Emily Dinan and Gavin Abercrombie and A. Stevie Bergman and Shannon Spruit and Dirk Hovy and Y-Lan Boureau and Verena Rieser. SafetyKit: First Aid for Measuring Safety for Open-domain Conversational Systems. Proceedings of the 60th Conference of the Chapter of the Association for Computational Linguistics, ACL 2022. (long paper) [acl anthology]

2. Gavin Abercrombie and Verena Rieser. Risk-graded Safety for Handling Medical Queries in Conversational AI.  2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL-IJCNLP 2022 [Arxiv]

3.  A. Stevie Bergman, Gavin Abercrombie, Shannon Spruit, Dirk Hovy, Emily Dinan, Y-Lan Boureau and Verena Rieser. Guiding the Release of Safer E2E Conversational AI through Value Sensitive Design. 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2022)

4.  Alessandro Suglia, Bhathiya Hemanthage, Malvina Nikandrou, George Pantazopoulos, Amit Parekh, Arash Eshghi, Claudio Greco, Ioannis Konstas, Oliver Lemon and Verena Rieser. Demonstrating EMMA: Embodied MultiModal Agent for Language-guided Action Execution in 3D Simulated Environments. 23rd Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2022)

5. Marco Casadio, Ekaterina Komendantskaya, Verena Rieser, Matthew Daggitt, Daniel Kienitz, Luca Arnaboldi and Wen Kokke. Why Robust Natural Language Understanding is a Challenge. 5th Workshop on Formal Methods for ML-Enabled Autonomous Systems. 2022.

6. Shikib Mehri, Jinho Choi, Luis Fernando D'Haro, Jan Deriu, Maxine Eskenazi, Milica Gasic, Dilek Hakkani-Tur, Zekang Li, Verena Rieser, Samira Shaikh, David Traum, Yi-Ting Yeh, Zhou Yu, Yizhe Zhang, Chen Zhang. Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges. 2022 [Arxiv]

7.  Luca M. Leisten and Verena Rieser. “”I Like You, as a Friend”: Voice Assistants’ Response Strategies to Sexual Harassment and Their Relation to Gender.” Human Perspectives on Spoken Human-Machine Interaction SpoHuMa 2022  preprint PsyArXiv,  published PDF

2021

1. Emily Dinan, Gavin Abercrombie, A. Stevie Bergman, Shannon Spruit, Dirk Hovy, Y-Lan Boureau, Verena Rieser. Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling. 2021 [Arxiv] [tools]

2. Amanda Cercas-Curry, Gavin Abercrombie and Verena Rieser. ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Detection in Conversational AI. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP) 2021. (long paper) [arXiv] [dataset]

3. David Howcroft and Verena Rieser. What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021. (short paper)

4.  Xinnuo Xu, Ondřej Dušek, Shashi Narayan, Verena Rieser, Ioannis Konstas. MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing Findings (EMNLP 2021 Findings) [arXiv]

5. Karin Sevengnani, David Howcroft, Ioannis Konstas and Verena Rieser. One-turn Topic Transitions for Open-Domain Dialogue. ACL 2021 (long paper). [ARXIV]

6. Xinnuo Xu, Ondrej Dušek, Verena Rieser, Ioannis Konstas. AGGGEN: Ordering and Aggregating while Generating. ACL 2021 (short paper). [Arxiv]

7. Gavin Abercrombie, Amanda Cercas Curry, Mugdha Pandya and Verena Rieser. Alexa, Google, Siri: What are Your Pronouns? Gender and Anthropomorphism in the Design and Perception of Conversational Assistants. ACL-IJCNLP 2021 3rd Workshop on Gender Bias in Natural Language Processing (GeBNLP 2021) [Arxiv]

2020

1. Emanuele Bastianelli, Andrea Vanzo, Pawel Swietojanski and Verena Rieser. SLURP: A Spoken Language Understanding Resource Package.  The 2020 Conference on Empirical Methods in Natural Language Processing  EMNLP 2020 [acl anthology][data]

2. Shubham Agarwal, Trung Bui, Joon-Young Lee, Ioannis Konstas and Verena Rieser. History for Visual Dialog: Do we really need it? (Long paper) The 58th Annual Meeting of the Association for Computational Linguistics ACL 2020. [acl anthology] [lay summary]

3. Xinnuo Xu, Ondřej Dušek, Jingyi Li, Verena Rieser and Ioannis Konstas. Fact-based Content Weighting for Abstractive Summarisation Evaluation. (Short paper) The 58th Annual Meeting of the Association for Computational Linguistics ACL 2020. [acl anthology] [lay summary]

4. Ondřej Dušek, Jekaterina Novikova, Verena Rieser. Evaluating the state-of-the-art of End-to-End Natural Language Generation: The E2E NLG challenge. Computer Speech & Language, Volume 59, Pages 123-156, 2020. [arxiv preprint] [free journal access]

5. David M. Howcroft, Anya Belz, Miruna-Adriana Clinciu, Dimitra Gkatzia, Sadid A. Hasan, Saad Mahamood, Simon Mille, Verena Rieser, Sashank Santhanam and Emiel van Miltenburg. Evaluation Sheets. A Checklist Inspired by Twenty Years of Confusion in Human Evaluation for NLG. 13th International Conference on Natural Language Generation (INLG 2020)

6. Amanda Cercas Curry, Judy Robertson and Verena Rieser. Conversational Assistants and Gender Stereotypes: Public Perceptions and Desiderata for Voice Personas. 2nd Workshop on Gender Bias in Natural Language Processing (GeBNLP) at COLING2020

2019

1. 1. 1. 1. 1. Verena Rieser. Let's Chat! Can Virtual Agents learn how to have a Conversation? Invited keynote at ACM IVA '19 ACM International Conference on Intelligent Virtual Agents. PARIS, France — July 02 - 05, 2019 [pdf]

            2. Amanda Cercas Curry and Verena Rieser. A Crowd-based Evaluation of Abuse Response Strategies in Conversational Agents. SigDial 2019. [pdf][dataset w/p prompts]

            3. Simon Keizer, Ondřej Dušek, Xingkun Liu and Verena Rieser.  User Evaluation of a Multi-dimensional Statistical Dialogue System. SigDial 2019. [code]

            4. Ondřej Dušek, Karin Sevegnagni, Ioannis Konstas and Verena Rieser. Automatic Quality Estimation for Natural Language Generation: Ranting (Jointly Rating and Ranking). 12th International Conference on Natural Language Generation (INLG2019), Tokyo, 2019.

            5. Ondřej Dušek,David Howcroft and Verena Rieser. Semantic Noise Matters for Neural Natural Language Generation. 12th International Conference on Natural Language Generation (INLG2019), Tokyo, 2019.

            6. David M. Howcroft, Karin Sevegnani, Ondrej Dusek and Verena Rieser.  Noise and Neural Natural Language Generation: Rubbish in, Rubbish out? EurNLP 2019, London (31.8% acceptance rate)

            7. Xingkun Liu, Arash Eshghi, Pawel Swietojanski and Verena Rieser. Benchmarking Natural Language Understanding Services for building Conversational Agents. Tenth International Workshop on Spoken Dialogue Systems Technology (IWSDS) 2019. [arxiv] [data]

2018

1. Xinnuo Xu, Ondrej Dusek, Yannis Konstas, and Verena Rieser. Better conversations by modeling, filtering, and optimizing for coherence and diversity. In: Conference on Empirical Methods in Natural Language Processing (EMNLP). Brussels, 2018. [arxiv] (25.5% acceptance rate)

2. Ondřej Dušek, Jekaterina Novikova, Verena Rieser. Findings of the E2E NLG Challenge. 11th International Conference on Natural Language Generation (INLG). Tilburg, 2018. (to appear) [arxiv]

3. Shubham Agarwal, Ondrej Dusek, Ioannis Konstas, Verena Rieser. Improving Context Modelling in Multimodal Dialogue Generation. 11th International Conference on Natural Language Generation (INLG 2018), Tilburg, The Netherlands, November 5-8, 2018. [arxiv]

4. Cercas Curry, A., Papaioannou, I., Suglia, A., Agarwal, S., Shalyminov, I., Xinnuo, X., Dusek, O., Eshghi, A., Konstas, I., Rieser, V., Lemon, O. Alana v2: Entertaining and Informative Open-domain Social Dialogue using Ontologies and Entity Linking, Alexa Prize Proceedings 2018, Amazon RE-INVENT.  Finalist of the Amazon Alexa Challenge 2018.

5. Shubham Agarwal, Ondrej Dusek, Ioannis Konstas, Verena Rieser. A Knowledge-Grounded Multimodal Search-Based Conversational Agent. The 2nd International Workshop on Search-Oriented Conversational AI (SCAI) at EMNLP 2018, Brussels, Belgium, 2018. [arxiv]

6. Jekaterina Novikova, Ondrej Dusek and Verena Rieser.  RankME: Reliable Human Ratings for Natural Language Generation. In: 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), New Orleans, 2018. [arxiv] (29% acceptance rate)

7. Amanda Cercas Curry and Verena Rieser. #MeToo Alexa: How Conversational Systems Respond to Sexual Harassment. Second Workshop on Ethics in NLP. NAACL 2018, New Orleans, 2018. [bib]

8. Amanda Cercas Curry and Verena Rieser. Sexual Harassment and Conversational AI. 2nd NAACL Workshop on Widening Natural Language Processing WiNLP, New Orleans, 2018.

9. Verena Rieser & Oliver Lemon. Baby Leonard Lemon! Human intelligence, Edinburgh 2018.

2017

1. Ioannis Papaioannou, Amanda Cercas Curry, Jose L. Part, Igor Shalyminov, Xinnuo Xu, Yanchao Yu, Ondrej Dušek, Verena Rieser, Oliver Lemon. An Ensemble Model with Ranking for Social Dialogue. In: NIPS workshop on Conversational AI: Today's Practice and Tomorrow's Potential, Long Beach, USA, 2017. (selected for oral presentation) [arxiv]

2. Ioannis Papaioannou, Amanda Cercas Curry, Jose L. Part, Igor Shalyminov, Xinnuo Xu, Yanchao Yu, Ondrej Dušek, Verena Rieser, Oliver Lemon. Alana: Social Dialogue using an Ensemble Model and a Ranker trained on User Feedback. In: AWS re:INVENT, Las Vegas, USA, 2017. [pdf]

3. Jekaterina Novikova, Ondrej Dusek and Verena Rieser. The E2E Dataset: New Challenges For End-to-End Generation. 18th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL 2017) (acceptance rate 30%)  Nominated for best paper.

4. Jekaterina Novikova, Ondrej Dusek, Amanda Cercas-Curry and Verena Rieser. Why We Need New Evaluation Metrics for NLG. EMNLP, Copenhangen, 2017 (acceptance rate 26%)

5. Dimitra Gkatzia, Oliver Lemon and Verena Rieser. Data-to-Text Generation Improves Decision-Making Under Uncertainty. IEEECIM Special Issue on Natural Language Generation with Computational Intelligence. 2017. Impact Factor: 3.65 [pdf]

6. Dirk Wollherr, Verena Rieser and Matthew Walter (Eds.)  Special Issue on Spatial Reasoning & Interaction for Real-World Robotics. Advanced Robotics, volume 32, issue 5, 2017.

7. Christian Landsiedel and Verena Rieser and Matthew Walter and Dirk Wollherr. A Review of Spatial Reasoning and Interaction for Real-World Robotics. Advanced Robotics 32(5), 222-241, 2017.

8. Ondrej Dusek and Verena Rieser. Referenceless Quality Estimation for Natural Language Generation. 1st Workshop on Learning to Generate Natural Language (LGNL 2017)

9. Jekaterina Novikova, Ondrej Dusek and Verena Rieser. Data-driven Natural Language Generation: Paving the Road to Success. WiNLP workshop, Vancouver 2017.

10. Simon Keizer and Verena Rieser. Learning Transferable Conversational Skills in a Multi-dimensional Framework. SemDial (Short Papers), Saarbrücken 2017. [arxiv]

11. Amanda Cercas Curry, Helen Hastie and Verena Rieser. A Review of Evaluation Techniques for Social Dialogue Systems. ICMI Workshop on Investigating Social Interactions with Artificial Agents. Glasgow 2017. [Arxiv pre-print]

2016

1. Dimitra Gkatzia, Oliver Lemon and Verena Rieser. Natural Language Generation enhances human decision-making with uncertain information. Annual meeting of the Association for Computational Linguistics (ACL 2016), Berlin, 2016. ArXiv [data][weather game]

2. Verena Rieser. Women listen and men look? How to best communicate risk to support decision-making. Understanding Uncertainty, 2016. [link]

3. Verena Rieser, Amy Isard and Dimitra Gkatzia. Proceedings of the 9th International Conference on Natural Language Generation (INLG'17). Edinburgh, September 2016. [website]

4. Simon Keizer and Verena Rieser. The MaDrIgAL project: Multi-Dimensional Interaction Management and Adaptive Learning. International Workshop on Domain Adaptation for Dialog Agents (DADA) 2016.

5. Jekaterina Novikova and Verena Rieser. The aNALoGuE Challenge: Non Aligned Language GEneration. The 9th International Natural Language Generation conference INLG, 2016.

6. Jekaterina Novikova, Oliver Lemon, Verena Rieser. Crowd-sourcing NLG Data: Pictures Elicit Better Data. The 9th International Natural Language Generation conference INLG, 2016. [data]

7. Eshrag Rafaee and Verena Rieser. A Hybrid Approach for Determining Sentiment Intensity of Arabic Twitter Phrases. Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval 2016), 2016. (winner of SemEval'16 challenge sub-task 7) [bib]

8. Dimitra Gkatzia, Verena Rieser and Oliver Lemon. How to Talk to Strangers: Minimising Regret when Generating Medical Reports for Unknown Users. IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Vancouver, Canada, 2016.

9. Phil Bartie, William Mackaness, Dimitra Gkatzia, Verena Rieser. The REAL Corpus: A Crowd-Sourced Corpus of Human Generated and Evaluated Spatial References to Real-World Urban Scenes. 10th International Conference on Language Resources and Evaluation (LREC'16). 2016. [data]

10. Amanda Cercas Curry and Verena Rieser. A Subjective Evaluation of Chatbot Engines. WOCHAT Shared Task Report. Second Workshop on Chatbots and Conversational Agent Technologies. 2016.

2015

1. Nina Dethlefs, Helen Hastie, Heriberto Cuayahuitl, Yanchao Yu, Verena Rieser and Oliver Lemon. Information Density and Overlap in Spoken Dialogue.  Computer Speech and Language (CSL), 2015.

2. Dimitra Gkatzia, Verena Rieser, Phil Bartie and Wiliam Mackaness. From the Virtual to the Real World: Referring to Objects in Spatial Real-World Images. In: Proc. of Conference on Empirical Methods in Natural Language Processing and Natural Language Learning (EMNLP 2015). Lisboa, Portugal, 2015. (Acceptance rate: 24%) pdf bib

3. Dimitra Gkatzia, Amanda Cercas Curry, Verena Rieser and Oliver Lemon. A game-based setup for data collection and task-based evaluation of uncertain information presentation. Demo Paper. 15th European Natural Language Generation 2015 workshop (ENLG 2015). Brighton, UK, 2015. pdf bib

4. Amanda Cercas Curry, Dimitra Gkatzia and Verena Rieser. Generating and Evaluating Landmark-based Navigation Instructions in Virtual Environments. Short Paper. 15th European Natural Language Generation 2015 workshop (ENLG 2015). Brighton, UK, 2015. pdf bib

5. Eshrag Refaee and Verena Rieser. Benchmarking Machine Translated Sentiment Analysis for Arabic Tweets. In: Proc. NAACL, Student Research Workshop 2015. bib

6. Verena Rieser and Dimitra Gkatzia. Generation for Things Unknown: Accounting for First-Time Users and Hidden Scenes. 1st International Workshop on Data-to-Text Generation. Edinburgh, UK, 2015.

7. Marta Vallejo, Verena Rieser and Dave Corne. Agent-Based Modelling for Green Space Allocation in Urban Areas: Factors Influencing Agent Behaviour. 7th Conference on Agents and Artificial Intelligence. Lisbon, Portugal, 2015.

8. Marta Vallejo, Verena Rieser and David Corne. Genetic Algorithm evaluation of green search allocation policies in multilevel complex urban scenarios. 15th International Conference on Computational Science (ICCS'15) Main Track, Reykjavík, Iceland, 2015.

9. Verena Rieser and Oliver Lemon. Baby Katarina. Edinburgh Royal Infirmary, 2015.

2014

1. Verena Rieser and Philippe Muller. Proceedings of the 17th Workshop on the Semantics and Pragmatics of Dialogue (SemDial’14 – DialWatt).

2. Micha Elsner and Verena Rieser. Proceedings of 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL). Discourse and Dialog. 2014, Gothenburg, Sweden.

3. Marta Vallejo, Verena Rieser and Dave Corne. Evolving optimal spatial allocation policies for complex and uncertain environments. Agents and Artificial Intelligence. In: Communications in Computer and Information Science (CCIS), Volume 449, pp 351-369. Springer-Verlag. 2014.

4. Eshrag Refaee and Verena Rieser. Evaluating Distant Supervision for Subjectivity and Sentiment Analysis on Arabic Twitter Feeds. In: Arabic NLP workshop (ANLP, co-located with EMNLP-2014) Qatar, 2014.

5. Verena Rieser. On the Use of Peer Feedback in Large Programming Classes. In: International Computing Education Research (ICER'14). Lightning Talk. Glasgow, 2014.

6. Dimitra Gkatzia, Verena Rieser, Alexander McSporran, Alistair McGowan, Alasdair Mort and Michaela Dewar. Generating Verbal Descriptions from Medical Sensor Data: A Corpus Study on User Preferences. Health Informatics Scotland (HIS'14). Glasgow, 2014.

7. Verena Rieser and Amanda Cercas Curry. Towards Generating Route Instructions Under Uncertainty: A Corpus Study. In: 18th Workshop on the Semantics and Pragmatics of Dialogue (SemDial/DialWatt) - Short Papers. Edinburgh, 2014.

8. Verena Rieser, Srinivasan Janarthanam, Andy Taylor, Yanchao Yu and Oliver Lemon: SpeechCity: A Conversational City Guide based on Open Data. In: 18th Workshop on the Semantics and Pragmatics of Dialogue (SemDial/DialWatt) - Short Papers. Edinburgh, 2014.

9. Wenshuo Tang, Zhuoran Wang, Verena Rieser and Oliver Lemon. Sample Efficient Learning of Strategic Dialogue Policies. In: 18th Workshop on the Semantics and Pragmatics of Dialogue (SemDial/DialWatt)  - Short Papers. Edinburgh, 2014. [pdf]

10. Aimilios Vourliotakis, Ioannis Efstathiou and Verena Rieser. Detecting Deception in Non-Cooperative Dialogue: A Smarter Adversary Cannot be Fooled That Easily. In: 18th Workshop on the Semantics and Pragmatics of Dialogue (SemDial/DialWatt)  - Short Papers. Edinburgh, 2014.[pdf]

11. Callum Main, Zhuoran Wang and Verena Rieser. Towards Deep Learning for Dialogue State: Tracking Using Restricted Bolzman Machines and Pretraining. In: 18th Workshop on the Semantics and Pragmatics of Dialogue (SemDial/DialWatt)  - Short Papers. Edinburgh, 2014. [pdf]

12. Nina Dethlefs, Heriberto Cuayahuitl, Helen Hastie, Verena Rieser and Oliver Lemon. Getting to Know Users: Accounting for the Variability in User Ratings. In: 18th Workshop on the Semantics and Pragmatics of Dialogue (SemDial/DialWatt)  - Short Papers. Edinburgh, 2014.

13. Verena Rieser, Oliver Lemon and Simon Keizer. Natural Language Generation as Incremental Planning Under Uncertainty: Adaptive Information Presentation for Statistical Dialogue Systems. IEEE/ACM Transactions on Audio, Speech and Language Processing, Volume 22, Issue 5, 2014. http://dx.doi.org/10.1109/TASL.2014.2315271

14. Oliver Lemon, Srini Janarthanam and Verena Rieser:  Reinforcement Learning Approaches to Natural Language Generation in Interactive Systems. In: Srinivas Bangalore and Amanda Stent, editors, Natural Language Generation in Interactive Systems. Cambridge University Press.

15. Nina Dethlefs, Heriberto Cuayáhuitl, Helen Hastie, Verena Rieser and Oliver Lemon. Cluster-based Prediction of User Ratings for Stylistic Surface Realisation, EACL 2014.

16. Eshrag Refaee and Verena Rieser.  An Arabic Twitter Corpus for Subjectivity and Sentiment Analysis. 9th International Conference on Language Resources and Evaluation (LREC'14). Reykjavik, Iceland, 2014.

17. Eshrag Refaee and Verena Rieser. Can We Read Emotions from a Smiley Face? Emoticon-based Distant Supervision for Subjectivity and Sentiment Analysis of Arabic Twitter Feeds. 5th International Workshop on EMOTION, SOCIAL SIGNALS, SENTIMENT & LINKED OPEN DATA. Reykjavik, Iceland, 2014.

18. Eshrag Refaee and Verena Rieser. Subjectivity and Sentiment Analysis of Arabic Twitter Feeds with Limited Resources. Workshop on Free/Open-Source Arabic Corpora and Corpora Processing Tools (OSACT). Reykjavik, Iceland, 2014.

19. Joanneke Kruijsen, Helen Bridle, Joanna Cloy, David Louton, Susan Rasmussen and Verena Rieser. Gaming for Sustainable Behavioural Change. In: BEHAVE Energy conference 2014, Oxford, 2014.

20. Helen Hastie, Marie-aude Aufaure, Panos Alexopoulos, Hugues Bouchard, Heriberto Cuayahuitl, Nina Dethlefs, Milica Gasic, James Henderson, Oliver Lemon, Xingkun Liu, Peter Mika, Nesrine Ben Mustapha, Tim Potter, Verena Rieser, Blaise Thomson, Pirros Tsiakoulis, Yves Vanrompay, Boris Villazon-Terrazas, Majid Yazdani, Steve Young and Yanchao Yu.  The PARLANCE mobile app for interactive search in English and Mandarin. In: Proceedings of SigDial 2014.

2013

1. Markus Guhe, Alex Lascarides, Kevin O’Connor, and Verena Rieser. Effects of Belief and Memory on Strategic Negotiation. In The 17th workshop on the Semantics and Pragmatics of Dialogue (SemDial/DamDial'13), Amsterdam, 2013.

2. Dave Murray-Rust, Verena Rieser, Derek T. Robinson, Vesna Milicic and Mark Rounsevell. Agent-based modelling of land use dynamics and residential quality of life for future scenarios. Environmental Modelling & Software, Volume 46, August 2013, Pages 75–89.

3. Marta Vallejo, Dave Corne and Verena Rieser. Evolving Urbanisation Policies: Using a Statistical Model to Accelerate Optimisation over Agent-Based Simulations. Full paper accepted for: 5th Conference on Agents and Artificial Intelligence. Barcelona, 2013. (14% acceptance rate)

4. Helen Hastie, Marie-Aude Aufaure, Panos Alexopoulos, Heriberto Cuayáhuitl, Nina Dethlefs, Milica Gasic, James Henderson, Oliver Lemon, Xingkun Liu, Peter Mika, Nesrine Ben Mustapha, Verena Rieser, Blaise Thomson, Pirros Tsiakoulis, Yves Vanrompay, Boris Villazon-Terrazas, Steve Young. Demonstration of the PARLANCE system: a data-driven incremental, spoken dialogue system for interactive search. SigDial demo session. Metz, 2013.

2012

1. Verena Rieser, Oliver Lemon, and Simon Keizer.  Opponent Modelling for Optimising Strategic Dialogue. The 16th workshop on the semantics and Pragmatics of Dialogue (SemDial/SeineDial'12). Paris, 2012.

2. D.T. Robinson, D. Murray-Rust, V. Rieser, V. Milicic, M. Rounsevell. Modelling the impacts of land system dynamics on human well-being: Using an agent-based approach to cope with data limitations in Koper, Slovenia. Computers, Environment and Urban Systems. Available online 9 February 2012.

3. Nina Dethlefs, Helen Hastie, Verena Rieser and Oliver Lemon. Optimising Incremental Dialogue Decisions Using Information Density for Interactive Systems. In: Proc. of Conference on Empirical Methods in Natural Language Processing and Natural Language Learning (EMNLP-CoNLL 2012), July 12–14, 2012, Jeju, Korea.

4. Nina Dethlefs, Helen Hastie, Verena Rieser and Oliver Lemon. Optimising Incremental Generation for Spoken Dialogue Systems: Reducing the Need for Fillers by Optimising Waiting Time and Content Re-ordering. To be presented at: International Conference on Natural Language Generation (INLG). 2012.

5. Verena Rieser and Oliver Lemon. Developing Dialogue Managers from limited amounts of Data. In: Data-Driven Methods for Adaptive Spoken Dialogue Systems Computational Learning for Conversational Interfaces. Oliver Lemon and Olivier Pietquin (Editors). 2012.

6. Oliver Lemon, Srini Janarthanam, and Verena Rieser. Statistical approaches to Adaptive Natural Language Generation. In: Data-Driven Methods for Adaptive Spoken Dialogue Systems Computational Learning for Conversational Interfaces. Oliver Lemon and Olivier Pietquin (Editors). 2012.

7. N. Asher, A. Lascarides,d O. Lemon, M. Guhe, V. Rieser, P. Muller, S. Afantenos, F. Benamara, L. Vieu and P. Denis, S. Paul, S. Keizer and C. Degremont. Modelling Strategic Conversation: the STAC project. The 16th workshop on the semantics and Pragmatics of Dialogue (SemDial/SeineDial'12). Paris, 2012.

8. Mark Rounsevell, Robert Dunford, Verena Rieser and Paula Harrison. Evaluating uncertainty in a multi-sectoral, climate change impacts and adaptation assessment: experiences from the CLIMSAVE project. Workshop on Uncertainty and Climate Change Adaptation. Lisbon, 2012.

9. Nina Dethlefs, Verena Rieser, Helen Hastie and Oliver Lemon: Towards Optimising Modality Allocation for Multimodal Output Generation in Incremental Dialogue. In. Proc. ECAI2012. Workshop on Machine Learning for Interactive Systems (MLIS). 2012.

10. Nina Dethlefs, Helen Hastie, Verena Rieser and Oliver Lemon. Optimising Incremental Generation for Information Presentation of Mobile Search Results. In: Proceedings of the Symposium for Influencing People With Information. Aberdeen. 2012.

11. S. Afantenos, N. Asher, F. Benamara, A. Cadilhac, C. Degremont, P. Denis, M. Guhe, S. Keizer, A. Lascarides, O. Lemon, P. Muller, S. Paul, V. Popescu, V. Rieser, and L. Vieu. Developing a corpus of strategic conversation in the Settlers of Catan. In Noriko Tomuro and Jose Zagal, editors, Proceedings of the 1st Workshop on Games and NLP (GAMNLP-12), page 7 p, 2012.

2011

1. *Verena Rieser and Oliver Lemon. Reinforcement Learning for Adaptive Dialogue Systems: A Data-driven Methodology for Dialogue Management and Natural Language Generation. Book Series: Theory and Applications of Natural Language Processing,  Springer,  2011 ( ISBN 978-3-642-24941-9). buy from: Amazon.com, Amazon.uk, Springer, GoogleEBook *Over 200 sales of printed copies and over 7,500 electronic downloads. Ranks amongst the 50% most downloaded eBooks in the relevant Springer eBook Collection in 2012.

2. Verena Rieser. Spatial-Temporal Optimisation for Adaptive Sustainable Forest Management. In: Workshop on Machine Learning for Sustainability (in association with NIPS'11). Granada, Spain, 2011.

3. Verena Rieser and Oliver Lemon. Learning and Evaluation of Dialogue Strategies for new Applications: Empirical Methods for Optimization from Small Data Sets. In: Computational Linguistics Vol. 37, No. 1, Pages 153-196. March 2011.

4. Verena Rieser, Simon Keizer, Xingkun Liu and Oliver Lemon: Adaptive Information Presentation for Spoken Dialogue Systems: Evaluation with Human Subjects. In: 13th European Workshop on Natural Language Generation (ENLG'11). Nancy, 2011.

5. Verena Rieser, Derek T. Robinson, Dave Murray-Rust, Mark Rounsevell. A Comparison of Genetic Algorithms and Reinforcement Learning for Optimising Sustainable Forest Management. In: GeoComputation, London 2011.

6. Derek T. Robinson, Dave Murray-Rust, Verena Rieser, Mark Rounsevell and Vensa Milicic.  Estimating the impacts of land-use change on human well-being and the provision of ecosystem services. American Association of Geographer's Conference 2011.

2010

1. Dave Murray-Rust and Verena Rieser and Mark Rounsevell.

2. Agent-Based Models for simulating peri-urban Land Use Relationships: A Proof-of-Concept Study. In: Managing the Urban Interface. Copenhagen 2010.

3. Verena Rieser and Oliver Lemon and Xingkun Liu. Optimising Information Presentation for Spoken Dialogue Systems. In: 48th Annual Metting of the Association for Computational Linguistics (ACL'10). [data]

4. Oliver Lemon and Srini Janarthanam and Verena Rieser. Generation under Uncertainty. In: International Conference on Natural Language Generation (INLG'10).

5. Verena Rieser and Oliver Lemon: Natural Language Generation as Planning Under Uncertainty for Spoken Dialogue Systems. In Krahmer, E. and Theune, M., editors, Empirical Methods in Natural Language Generation, volume 5980 of Lecture Notes in Computer Science. Springer, Berlin / Heidelberg.

2009

1. Xingkun Liu and Verena Rieser and Oliver Lemon.

2. A Wizard-of-Oz interface to study Information Presentation strategies for Spoken Dialogue Systems. In: Proceedings of the First International Workshop on Spoken Dialogue Systems (IWSDS). 2009. [data]

3. Cedric Boidin and Verena Rieser and Lonneke van der Plas and Oliver Lemon and Jonathan Chevelu. Predicting how it sounds: Re-ranking dialogue prompts based on TTS quality for adaptive Spoken Dialogue Systems. In: Proceedings of the Interspeech Special Session: Machine Learning for Adaptivity in Spoken Dialogue. 2009.

4. Verena Rieser and Oliver Lemon. Natural Language Generation as Planning Under Uncertainty for Spoken Dialogue Systems. In: 12th Conference of the European Chapter of the Association for Computational Linguistics (EACL). 2009. [ArXiv][data]

5. Verena Rieser and Oliver Lemon. Learning Human Multimodal Dialogue Strategies. In: Journal of Natural Language Engineering. 2009. This paper currently ranks 3rd amongst the 10 most downloaded papers of JNLE in 2010.

2008

1. Verena Rieser.

2. Bootstrapping Reinforcement Learning-based Dialogue Strategies from Wizard-of-Oz data. (4.1MB) Ph.D. thesis, Saarland University, Saarbruecken Dissertations in Computational Linguistics and Language Technology, Vol 28, Oct 2008.

3. Verena Rieser and Oliver Lemon. Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz data: Bootstrapping and Evaluation. In: Proc. of the 46th Annual Meeting of the Association for Computational Linguistics (ACL/HLT), Columbus, 2008.

4. Verena Rieser and Oliver Lemon. Automatic Learning and Evaluation of User-Centered Objective Functions for Dialogue System Optimisation. In: Proc. of the 6th International Conference on Language Resources and Evaluation (LREC), Marrakech, 2008.

5. Verena Rieser and Oliver Lemon. Simulation-based Learning of Optimal Multimodal Presentation Strategies from Wizard-of-Oz data. In: Proc. of the AISB Symposium on Multimodal Output Generation (MOG), Aberdeen, 2008.

6. Verena Rieser and Oliver Lemon. Does this list contain what you were searching for? Learning adaptive dialogue strategies for Interactive Question Answering. Journal of Natural Language Engineering (special issue on Interactive Question Answering) 15 (1): 55-72, 2008.

2007

1. Verena Rieser and Oliver Lemon. Learning dialogue strategies for interactive database search. In: Proc of the 10th International Conference of Spoken Language Processing (Interspeech/ICSLP), Special Session on Machine Learning for Spoken Dialogue Systems, Antwerp, 2007.

2006

1. Verena Rieser and Oliver Lemon.

2. Using Machine Learning to Explore Human Multimodal Clarification Strategies. In: Proc. of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING/ACL), Sydney, 2006.

3. Verena Rieser and Oliver Lemon. Cluster-based User Simulations for Learning Dialogue Strategies. In: Proc.\ of the 9th International Conference of Spoken Language Processing (Interspeech/ICSLP), Pittsburgh, 2006.

4. Verena Rieser and Oliver Lemon. Using Logistic Regression to Initialise Reinforcement-Learning-based Dialogue Systems. In: Proc.\ of the IEEE/ACL workshop on Spoken Language Technology (SLT), Palm Beach, Aruba, 2006. related material

5. Kruijff-Korbayová,Tilman Becker, Nate Blaylock, Ciprian Gerstenberger, Michael Kaisser, Peter Poller, Verena Rieser, Jan Schehl. The Sammie Corpus of Multimodal Dialogues with an MP3 Player. In: Proc. of the 5th International Conference on Language Resources and Evaluation (LREC), Genoa, 2006.

6. Kruijff-Korbayová, Verena Rieser, Jan Schehl, Tilman Becker. The Sammie Multimodal Dialogue Corpus Meets the Nite XML Toolkit. In: Proceedings of the Fifth Workshop on multi-dimensional Markup in Natural Language Processing (in association with EACL), Trento, 2006.

2005

1. Verena Rieser and Johanna Moore.

2. Implications for Generating Clarification Requests in Task-oriented Dialogues. In: Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL-05), Ann Arbor.

3. Verena Rieser and Ivana Kruijff-Korbayová and Oliver Lemon. A Corpus Collection and Annotation Framework for Learning Multimodal Clarification Strategies. In: Proc.\ of the 6th SIGdial Workshop on Discourse and Dialogue, Lisbon, 2005.

4. Verena Rieser and Ivana Kruijff-Korbayová and Oliver Lemon. Towards Learning Multimodal Clarification Strategies. In: Proc.\ of the 7th International Conference on Multimodal Interfaces (ICMI), Doctoral Spotlight, Trento, 2005.

5. Verena Rieser and Ivana Kruijff-Korbayová. Dialogsysteme. In: Cramer, Irene and Sabine Schulte im Walde (eds.): Studienbibliographie Computerlinguistik und Sprachtechnologie. (Studienbibliographien Sprachwissenschaft, 36) Im Auftrag des Instituts für Deutsche Sprache,pp.78--80, Mannheim,Tübingen: Stauffenburg Verlag Brigitte Narr (in German). online version

6. Ivana Kruijff-Korbayová, Nate Blaylock, Ciprian Gerstenberger, Verena Rieser, Tilman Becker, Michael Kaisser, Peter Poller, Jan Schehl. An Experiment Setup for Collecting Data for Adaptive Output Planning in a Multimodal Dialogue System. In: Proc.\ of the 10th European Workshop on Natural Language Generation (ENLG), Aberdeen, 2005.

7. Ivana Kruijff-Korbayová, Nate Blaylock, Ciprian Gerstenberger, Verena Rieser, Tilman Becker, Michael Kaisser, Peter Poller, Jan Schehl. Presentation Strategies for Flexible Multimodal Interaction with a Music Player. In: Proc.\ of the 9th SEMdial Workshop on on the Semantics and Pragmatics of Dialogues, Nancy, 2005.

2003

For my Master thesis at the University of Regensburg (2003) I designed and implemented a spoken user interface to a washing machine (in collaboration with BOSCH/Siemens/Hausgeräte and SpeechExperts). Read here how Hermine set CeBit 2003 in a spin. International news cover, including Financial Times, The New York Times, Focus and Süddeutsche Zeitung.