Publications

From 2011 onwards: see the Interaction Lab Publications page for latest publications and my publications on Google Scholar
BOOK: Oliver Lemon and Olivier Pietquin (eds.) "Data-driven Methods for Adaptive Spoken Dialogue Systems: Computational Learning for Conversational Interfaces", Springer, 2012 [buy from Amazon] [buy from Springer]
BOOK: Verena Rieser and Oliver Lemon "Reinforcement Learning for Adaptive Dialogue Systems: A Data-driven Methodology for Dialogue Management and Natural Language Generation" Book Series:Theory and Applications of Natural Language Processing, Springer, 2011 ( ISBN 978-3-642-24941-9)
(Link to bibtex for my publications)
Oliver Lemon, "Conversational Interfaces", in Data-driven Methods for Adaptive Spoken Dialogue Systems: Computational Learning for Conversational Interfaces, Springer, 2012
Oliver Lemon, Srini Janarthanam, and Verena Rieser, "Statistical Approaches to Adaptive Natural Language Generation", in Data-driven Methods for Adaptive Spoken Dialogue Systems: Computational Learning for Conversational Interfaces, Springer, 2012
Verena Rieser and Oliver Lemon, "Developing Dialogue Managers from Limited amonts of Data", in Data-driven Methods for Adaptive Spoken Dialogue Systems: Computational Learning for Conversational Interfaces, Springer, 2012
Oliver Lemon, "Learning what to say and how to say it: joint optimization of spoken dialogue management and Natural Language Generation", Computer Speech and Language, 25(2), 2011.
Verena Rieser and Oliver Lemon. "Learning and Evaluation of Dialogue Strategies for new Applications: Empirical Methods for Optimization from Small Data Sets". In: Computational Linguistics, 37(1), 2011.
Alan W Black, Susanne Burger, Alistair Conkie, Helen Hastie, Simon Keizer, Oliver Lemon, Nicolas Merigaud, Gabriel Parent, Gabriel Schubiner, Blaise Thomson, Jason D. Williams, Kai Yu, Steve Young and Maxine Eskenazi, "Spoken Dialog Challenge 2010: Comparison of Live and Control Test Results", SIGDIAL 2011
Srinivasan Janarthanam, Helen Hastie, Oliver Lemon and Xingkun Liu, " 'The day after the day after tomorrow? ' A machine learning approach to adaptive temporal expression generation: training and evaluation with real users", SIGDIAL 2011
The CLASSiC project, web article, IEEE Signal Processing Society, 2011http://www.signalprocessingsociety.org/technical-committees/list/sl-tc/spl-nl/2011-02/CLASSiC-project/
Alyssa Alcorn, Helen Pain, Gnanathusharan Rajendran, Tim Smith, Oliver Lemon, Kaska Porayska-Pomsta, Mary Ellen Foster, Katerina Avramides, Christopher Frauenberger, Sara Bernardini, ``Social Communication between Virtual Characters and Children with Autism'', Artificial Intelligence and Education, 2011
O. LEMON, O. PIETQUIN, "Introduction to Special Issue on Machine Learning for Adaptivity in Spoken Dialogue Systems". In ACM Transactions on Speech and Language Processing, 7(3), 2011.
Paul A. Crook, Brieuc Roblin, Hans-Wolfgang Loidl and Oliver Lemon. Parallel Computing and Practical Constraints when applying the Standard POMDP Belief Update Formalism to Spoken Dialogue Management". International Workshop Series on Spoken Dialogue Systems Technology (IWSDS) 2011
Paul A. Crook and Oliver Lemon. "Lossless Value Directed Compression of Complex User Goal States for Statistical Spoken Dialogue Systems". Interspeech 2011
Verena Rieser, Simon Keizer, Oliver Lemon, and Xingkun Liu, "Adaptive Information Presentation for Spoken Dialogue Systems: Evaluation with human subjects", ENLG 2011
K. Porayska-Pomsta, C. Frauenberger, H. Pain, G. Rajendran, T. Smith, R. Menzies, M. E. Foster, A. Alcorn, S. Wass, S. Bernardini, K. Avramides, W. Keay-Bright, J. Chen, A. Waller, K. Guldberg, J. Good, and O. Lemon, "Developing technology for autism: an interdisciplinary approach", Journal of Personal and Ubiquitous Computing, to appear
Srini Janarthanam and Oliver Lemon, "Learning to Adapt to Unknown Users: Referring Expression Generation in Spoken Dialogue Systems", ACL 2010
Verena Rieser, Oliver Lemon, and Xingkun Liu, "Optimising Information Presentation for Spoken Dialogue Systems", ACL 2010
Heriberto Cuayáhuitl, Steve Renals, Oliver Lemon, Hiroshi Shimodaira, "Evaluation of a hierarchical reinforcement learning spoken dialogue system", Computer Speech and Language, 24(2):395-429, 2010.
Mary Ellen Foster, Katerina Avramides, Sara Bernardini, Jingying Chen, Christopher Frauenberger, Oliver Lemon, and Kaska Porayska-Pomsta. "Supporting Children's Social Communication Skills through Interactive Narratives with Virtual Characters". In Proceedings of ACM Multimedia 2010, Florence, Italy, October 2010.
Oliver Lemon and Ioannis Konstas, "User Simulations for Context-sensitive Speech Recognition in Spoken Dialogue Systems", EACL 2009
Jingying Chen and Oliver Lemon, "Robust Facial Detection and Tracking for Head Pose Estimation in a Novel Multimodal Interface for Social Skills Learning", BMVA meeting on Facial Analysis and Animation, 2009
Matthew Frampton and Oliver Lemon, "Recent research advances in Reinforcement Learning in Spoken Dialogue Systems", Knowledge Engineering Review, 24(4): 375-408, 2009.
Kallirroi Georgila, Oliver Lemon, James Henderson, Johanna Moore, "Automatic annotation of context and speech acts for dialogue corpora", Journal of Natural Language Engineering , 2009
Verena Rieser and Oliver Lemon, "Learning Human Multimodal Dialogue Strategies", Journal of Natural Language Engineering, 2009

Verena Rieser and Oliver Lemon, "Natural Language Generation as Planning under Uncertainty for Spoken Dialogue Systems", EACL 2009
Srini Janarthanam and Oliver Lemon, "Learning Lexical Alignment Policies for Generating Referring Expressions for Spoken Dialogue Systems", ENLG 2009
Srini Janarthanam and Oliver Lemon "A Wizard-of-Oz environment to study Referring Expression Generation in a Situated Spoken Dialogue Task", ENLG 2009
Srini Janarthanam and Oliver Lemon, "Learning Adaptive Referring Expression Generation Policies for Spoken Dialogue Systems using Reinforcement Learning" Proc. SEMdial 2009
Paul A. Crook and Oliver Lemon."Accurate Probability Estimation of Hypothesised User Acts for POMDP Approaches to Dialogue Management" in Proceedings of the 12th Annual Research Colloquium of the special-interest group for computational linguistics in the UK and Ireland (CLUKI 2009), 2009. Abstract, pdf.
Oliver Lemon, "Adaptive Natural Language Generation in Dialogue using Reinforcement Learning" , SEMdial 2008
James Henderson, Oliver Lemon, and Kallirroi Georgila, "Hybrid Reinforcement / Supervised Learning of Dialogue Policies from Fixed Datasets", Computational Linguistics, 34(4) , 2008
Verena Rieser and Oliver Lemon, "Does this list contain what you were searching for? Learning adaptive dialogue strategies for Interactive Question Answering", Journal of Natural Language Engineering, 15(1), 2008
Verena Rieser and Oliver Lemon, "Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz data: Bootstrapping and Evaluation" , ACL 2008
Srini Janarthanam and Oliver Lemon "User simulations for online adaptation and knowledge-alignment in Troubleshooting dialogue systems." , SEMdial 2008
James Henderson and Oliver Lemon, "Mixture Model POMDPs for Efficient Handling of Uncertainty in Dialogue Management", ACL 2008
Matthew Frampton and Oliver Lemon,"Using Dialogue Acts to learn better repair strategies for Spoken Dialogue Systems", ICASSP 2008
Ivan Meza-Ruiz, Sebastian Riedel, Oliver Lemon, "Accurate Statistical Spoken Language Understanding from limited development resources", ICASSP 2008
Verena Rieser and Oliver Lemon, "Simulation-based Learning of Optimal Multimodal Presentation Strategies from Wizard-of-Oz data", AISB Multimodal Output Generation symposium 2008
Oliver Lemon and Olivier Pietquin "Machine Learning for Spoken Dialogue Systems" Interspeech 2007.
Oliver Lemon and Xingkun Liu "Dialogue Policy Learning for combinations of Noise and User Simulation: transfer results" SIGdial 2007.
Verena Rieser and Oliver Lemon, "Learning dialogue strategies for interactive database search" Interspeech 2007.
Heriberto Cuayahuitl, Steve Renals, Oliver Lemon, and Hiroshi Shimodaira "Hierarchical Dialogue Optimization Using Semi-Markov Decision Processes" Interspeech 2007.
Oliver Lemon, Kallirroi Georgila, James Henderson, "Evaluating Effectiveness and Portability of Reinforcement Learned Dialogue Strategies with real users: the TALK TownInfo Evaluation", IEEE/ACL Spoken Language Technology, 2006.
Oliver Lemon, Kallirroi Georgila, James Henderson, and Matthew Stuttle, "An ISU dialogue system exhibiting reinforcement learning of dialogue policies: generic slot-filling in the TALK in-car system", EACL 2006.
Oliver Lemon, Xingkun Liu, Daniel Shapiro, and Carl Tollander, "Hierarchical Reinforcement Learning of Dialogue Policies in a development environment for dialogue systems: REALL-DUDE", 10th SemDial Workshop on the Semantics and Pragmatics of Dialogue, (demonstration systems), BRANDIAL 2006
Kalliroi Georgila, James Henderson, Oliver Lemon, "User Simulation for Spoken Dialogue Systems: Learning and Evaluation", Interspeech 2006
Verena Rieser and Oliver Lemon, "Cluster-based User Simulations for Learning Dialogue Strategies", Interspeech 2006
Verena Rieser and Oliver Lemon, "Using Machine Learning to Explore Human Multimodal Clarification Strategies" ACL 2006.
Matthew Frampton and Oliver Lemon, "Learning More Effective Dialogue Strategies Using Limited Dialogue Move Features" ACL 2006.
Verena Rieser and Oliver Lemon, "Using Logistic Regression to initialise Reinforcement-Learning-based dialogue systems", IEEE/ACL Spoken Language Technology, 2006.
Heriberto Cuayahuitl, Steve Renals, Oliver Lemon, Hiroshi Shimodaira, "Reinforcement Learning of dialogue strategies with Hierarchical Abstract Machines", IEEE/ACL Spoken Language Technology, 2006.
James Henderson, Oliver Lemon, and Kallirroi Georgila "Hybrid Reinforcement/Supervised Learning for Dialogue Policies from COMMUNICATOR data", IJCAI workshop 2005
Kallirroi Georgila, James Henderson, Oliver Lemon, Learning User Simulations for Information State Update Dialogue Systems", Interspeech 2005
Verena Rieser and Oliver Lemon, "Cluster-based User Simulations for Learning Dialogue Strategies", Interspeech 2005
Malte Gabsdil and Oliver Lemon, "Combining Acoustic and Pragmatic Features to Predict Recognition Performance in Spoken Dialogue Systems" in proceedings of ACL 2004.

Context-sensitive speech recognition in multimodal dialogue systems:

Oliver Lemon and Ioannis Konstas, "User Simulations for Context-sensitive Speech Recognition in Spoken Dialogue Systems", EACL 2009.
Oliver Lemon and Alexander Gruenstein, "Multithreaded context for robust conversational interfaces: context-sensitive speech recognition and interpretation of corrective fragments," ACM Transactions on Computer-Human Interaction (ACM TOCHI), 11(3): 241-267, 2004 (1372 downloads from ACM, 10/1/14)
Oliver Lemon, "Context-sensitive speech recognition in ISU dialogue systems: results for the grammar switching approach", SEMDIAL 2004.
Malte Gabsdil and Oliver Lemon, "Combining Acoustic and Pragmatic Features to Predict Recognition Performance in Spoken Dialogue System" in proceedings of ACL 2004.

Multimodal Generation and Natural Language Generation (NLG):

Oliver Lemon, "Adaptive Natural Language Generation in Dialogue using Reinforcement Learning." SEMdial 2008
Verena Rieser and Oliver Lemon, "Natural Language Generation as Planning under Uncertainty for Spoken Dialogue Systems", EACL 2009.
Srini Janarthanam and Oliver Lemon, "Learning Lexical Alignment Policies for Generating Referring Expressions for Spoken Dialogue Systems", ENLG 2009
Srini Janarthanam and Oliver Lemon, "A Wizard-of-Oz environment to study Referring Expression Generation in a Situated Spoken Dialogue Task", ENLG 2009
Johanna Moore, Mary Ellen Foster, Oliver Lemon, and Michael White, "Generating Tailored, Comparative Descriptions in Spoken Dialogue". In Proc. of the 17th International FLAIRS Conference, 2004.
Oliver Lemon, Alexander Gruenstein, Randolph Gullett, Alexis Battle, Laura Hiatt, and Stanley Peters. "Generation of collaborative spoken dialogue contributions in dynamic task environments". In Reva Freedman and Charles Callaway, editors, AAAI Spring Symposium on Natural Language Generation, 2003 . [pdf]
Beth-Ann Hockey, Oliver Lemon, et al., "Targeted Help for Spoken Dialogue Systems: intelligent feedback improves naive users' performance," in proceedings of EACL 2003

Development environments for multimodal dialogue systems:

Oliver Lemon, Xingkun Liu, and Helen Hastie, " `Build your own' spoken dialogue systems: automatically generating ISU dialogue systems from business user resources", (demonstration system), COLING 2008
Oliver Lemon and Xingkun Liu, "DUDE: a Dialogue and Understanding Development Environment, mapping Business Process Models to Information State Update dialogue systems", EACL 2006.
Oliver Lemon, Xingkun Liu, Daniel Shapiro, and Carl Tollander "Hierarchical Reinforcement Learning of Dialogue Policies in a development environment for dialogue systems: REALL-DUDE", 10th SemDial Workshop on the Semantics and Pragmatics of Dialogue, (demonstration systems), BRANDIAL 2006

Annotation standards/frameworks for multimodal dialogue corpora:

The TALK project DTD see TALK project Deliverable D4.1, 2005
Kallirroi Georgila and Oliver Lemon and James Henderson, "Automatic annotation of COMMUNICATOR dialogue data for learning dialogue strategies and user simulations", 9th SEMDIAL, DIALOR, 2005
Verena Rieser, Ivana Kruijff-Korbayova, and Oliver Lemon, "A corpus collection and annotation framework for learning multimodal clarification strategies", In SIGdial 2005.

Multimodal Dialogue management:

Johan Bos, Ewan Klein, Oliver Lemon, and Tetsushi Oka, "DIPPER: Description and Formalisation of an Information-State Update Dialogue System Architecture" , in proceedings of 4th SIGdial Workshop on Discourse and Dialogue, pages 115-124, 2003
Oliver Lemon, Alexander Gruenstein, and Stanley Peters, "Collaborative Activities and Multi-tasking in Dialogue Systems." Traitement Automatique des Langues (TAL), special issue on dialogue, 43(2): 131 - 154, 2002.

Other Journal Publications (logic and multimodal reasoning, robotics):

Oliver Lemon and Ian Pratt. On the insufficiency of linear diagrams for syllogisms . Notre Dame Journal of Formal Logic, 39(4):573 - 580, 1998.
Ian Pratt and Oliver Lemon, Ontologies for Plane, Polygonal Mereotopology . Notre Dame Journal of Formal Logic, 38(2): 225-245, 1997.
Oliver Lemon, Maarten de Rijke, and Atsushi Shimojima. "Efficacy of Diagrammatic Reasoning." (Editorial) Journal of Logic, Language, and Information, 8(3):265-271, 1999.
Keith Stenning and Oliver Lemon. Aligning Logical and Psychological perspectives on Diagrammatic Reasoning. Artificial Intelligence Review, 15: 29-62, 2001. (Also in book : "Thinking with Diagrams", Kluwer)
Oliver Lemon and Ian Pratt, "Complete Logics for Qualitative Spatial Reasoning," Journal of Visual Languages and Computing, 9:5-21, 1998.
Oliver Lemon and Ulrich Nehmzow, "The scientific status of mobile robotics: multiple-resolution mapping as a case study," Journal of Robotics and Autonomous Systems, 24(1-2): 5-15, 1998.
Oliver Lemon and Ian Pratt, "Logics for Geographic Information," Journal of Geographical Systems, 1(1): 75-90, 1999.
Oliver Lemon and Ian Pratt, Spatial Logic and the Complexity of Diagrammatic Reasoning , Machine Graphics and Vision, 6(1): 89-108, 1997.
Oliver Lemon, "Semantical Foundations of Spatial Logic", Knowledge Representation (KR), 1996.
Oliver Lemon and Ian Pratt, "Logical and Diagrammatic Reasoning", in Proc. the 19th annual Conference of the Cognitive Science Society, p. 430-435. Lawrence Erlbaum Associates, New Jersey, 1997.

.... and see my publications on Google Scholar

Publications by year: (since 2011: no longer maintained - please see Google scholar!)

2010

Oliver Lemon, "Learning what to say and how to say it: joint optimization of spoken dialogue management and Natural Language Generation", Computer Speech and Language
Srini Janarthanam and Oliver Lemon, "Learning to Adapt to Unknown Users: Referring Expression Generation in Spoken Dialogue Systems", ACL 2010
Verena Rieser, Oliver Lemon and Xingkun Liu, "Optimising Information Presentation for Spoken Dialogue Systems", ACL 2010
Heriberto Cuayáhuitl, Steve Renals, Oliver Lemon, Hiroshi Shimodaira, "Evaluation of a hierarchical reinforcement learning spoken dialogue system", Computer Speech and Language, 24(2):395-429, 2010.

2009

Oliver Lemon and Ioannis Konstas, "User Simulations for Context-sensitive Speech Recognition in Spoken Dialogue Systems", EACL 2009
Matthew Frampton and Oliver Lemon, "Recent research advances in Reinforcement Learning in Spoken Dialogue Systems", Knowledge Engineering Review, 24(4): 375-408, 2009.
Verena Rieser and Oliver Lemon, "Learning Human Multimodal Clarification Strategies for use in Dialogue Systems", Journal of Natural Language Engineering, 16 (1), 3-23, 2009.
Verena Rieser and Oliver Lemon, "Natural Language Generation as Planning under Uncertainty for Spoken Dialogue Systems", EACL 2009
Srini Janarthanam and Oliver Lemon, "Learning Lexical Alignment Policies for Generating Referring Expressions for Spoken Dialogue Systems", ENLG 2009
Srini Janarthanam and Oliver Lemon, "A Wizard-of-Oz environment to study Referring Expression Generation in a Situated Spoken Dialogue Task", ENLG 2009

2008

Oliver Lemon, "Adaptive Natural Language Generation in Dialogue using Reinforcement Learning." , SEMdial 2008
James Henderson, Oliver Lemon, and Kallirroi Georgila, "Hybrid Reinforcement / Supervised Learning of Dialogue Policies from Fixed Datasets", Computational Linguistics 34(4) , 2008
Verena Rieser and Oliver Lemon, "Does this list contain what you were searching for? Learning adaptive dialogue strategies for Interactive Question Answering", Journal of Natural Language Engineering, 15(1), 2008
Verena Rieser and Oliver Lemon, "Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz data: Bootstrapping and Evaluation" , ACL 2008
Srini Janarthanam and Oliver Lemon "User simulations for online adaptation and knowledge-alignment in Troubleshooting dialogue systems." , SEMdial 2008
Matthew Frampton and Oliver Lemon,"Using Dialogue Acts to learn better repair strategies for Spoken Dialogue Systems", ICASSP 2008
Ivan Meza-Ruiz, Sebastian Riedel, Oliver Lemon, "Accurate Statistical Spoken Language Understanding from limited development resources", ICASSP 2008
Verena Rieser and Oliver Lemon, "Simulation-based Learning of Optimal Multimodal Presentation Strategies from Wizard-of-Oz data", AISB MOG symposium 2008
Oliver Lemon, Xingkun Liu, and Helen Hastie, " `Build your own' spoken dialogue systems: automatically generating ISU dialogue systems from business user resources", (demonstration system), COLING 2008
James Henderson and Oliver Lemon, "Mixture Model POMDPs for Efficient Handling of Uncertainty in Dialogue Management", ACL 2008

2007

Oliver Lemon and Olivier Pietquin "Machine Learning for Spoken Dialogue Systems" Interspeech 2007.
Oliver Lemon and Xingkun Liu "Dialogue Policy Learning for combinations of Noise and User Simulation: transfer results" SIGdial 2007.
Verena Rieser and Oliver Lemon, "Learning dialogue strategies for interactive database search" Interspeech 2007.
Heriberto Cuayahuitl, Steve Renals, Oliver Lemon, and Hiroshi Shimodaira "Hierarchical Dialogue Optimization Using Semi-Markov Decision Processes" Interspeech 2007.

2006

Oliver Lemon, Kallirroi Georgila, James Henderson, "Evaluating Effectiveness and Portability of Reinforcement Learned Dialogue Strategies with real users: the TALK TownInfo Evaluation", IEEE/ACL Spoken Language Technology, 2006.
Oliver Lemon, Kallirroi Georgila, James Henderson, and Matthew Stuttle, "An ISU dialogue system exhibiting reinforcement learning of dialogue policies: generic slot-filling in the TALK in-car system", EACL 2006.
Oliver Lemon, Xingkun Liu, Daniel Shapiro, and Carl Tollander, "Hierarchical Reinforcement Learning of Dialogue Policies in a development environment for dialogue systems: REALL-DUDE", 10th SemDial Workshop on the Semantics and Pragmatics of Dialogue, (demonstration systems), BRANDIAL 2006
Kalliroi Georgila, James Henderson, Oliver Lemon, "User Simulation for Spoken Dialogue Systems: Learning and Evaluation", Interspeech 2006
Verena Rieser and Oliver Lemon, "Cluster-based User Simulations for Learning Dialogue Strategies", Interspeech 2006
Verena Rieser and Oliver Lemon, "Using Machine Learning to Explore Human Multimodal Clarification Strategies" ACL 2006.
Matthew Frampton and Oliver Lemon, "Learning More Effective Dialogue Strategies Using Limited Dialogue Move Features" ACL 2006.
Verena Rieser and Oliver Lemon, "Using Logistic Regression to initialise Reinforcement-Learning-based dialogue systems", IEEE/ACL Spoken Language Technology, 2006.
Heriberto Cuayahuitl, Steve Renals, Oliver Lemon, Hiroshi Shimodaira, "Reinforcement Learning of dialogue strategies with Hierarchical Abstract Machines", IEEE/ACL Spoken Language Technology, 2006.
G. Andreani, G. Di Fabbrizio, M. Gilbert, D. Gillick, D. Hakkani-Tur, Oliver Lemon, "Let's DiSCoH: collecting an annotated open corpus with dialogue acts and reward signals for natural language helpdesks", IEEE/ACL Spoken Language Technology, 2006.
Dave Toney, Johanna Moore, Oliver Lemon, "Developing Conversational Interfaces with XCS", International Workshop on Learning Classifier Systems (IWLCS) 2006
Dave Toney, Johanna Moore, Oliver Lemon, "Evolving optimal inspectable strategies for spoken dialogue systems", HLT-NAACL 2006

2005

James Henderson, Oliver Lemon, and Kallirroi Georgila "Hybrid Reinforcement/Supervised Learning for Dialogue Policies from COMMUNICATOR data", IJCAI workshop 2005
Kallirroi Georgila, James Henderson, Oliver Lemon, Learning User Simulations for Information State Update Dialogue Systems", Interspeech 2005
Verena Rieser and Oliver Lemon, "Cluster-based User Simulations for Learning Dialogue Strategies", Interspeech 2005

2004:

Oliver Lemon and Alexander Gruenstein, "Multithreaded context for robust conversational interfaces: context-sensitive speech recognition and interpretation of corrective fragments," ACM Transactions on Computer-Human Interaction (ACM TOCHI), 11(3): 241-267, 2004
Malte Gabsdil and Oliver Lemon, "Combining Acoustic and Pragmatic Features to Predict Recognition Performance in Spoken Dialogue Systems" in proceedings of ACL 2004.

.... and see my publications on Google Scholar