EACL 2009 tutorial materials (OliverLemon)

Reinforcement Learning for Adaptive Dialogue Systems
by Oliver Lemon and Verena Rieser

Location/dates: Tuesday 31 March at the conference of the European Association for Computational Linguistics, Athens, March 30-31, 2009

Updated slides (6/4/09):

Reading list:

Introductory material:

Oliver Lemon and Olivier Pietquin. Machine Learning for Spoken Dialogue Systems. Interspeech, 2007.
Richard Sutton and Andrew Barto. Reinforcement Learning. MIT Press, 1998.
J. Schatzmann, K. Weilhammer, M. Stuttle, S. Young. (2006). A Survey of Statistical User Simulation Techniques for Reinforcement-Learning of Dialogue Management Strategies. Knowledge Engineering Review 21(2): 97-126.
J. Williams and S. Young (2007). Partially Observable Markov Decision Processes for Spoken Dialog Systems. Computer Speech and Language 21(2):231-422.
M Walker, C. Kamm, and D. Litman. Towards Developing General Models of Usability with PARADISE. Natural Language Engineering, 6(3), 2000.

Applications:

Satinder Singh, Diane Litman, Michael Kearns, and Marilyn Walker. Optimizing dialogue management with reinforcement learning: Experiments with the NJFun system. Journal of Artificial Intelligence Research (JAIR), 2002.
Marilyn A. Walker. An Application of Reinforcement Learning to Dialogue Strategy Selection in a Spoken Dialogue System for Email . Journal of Artificial Intelligence Research, Vol 12., pp. 387-416, 2000.
James Henderson, Oliver Lemon, and Kallirroi Georgila. Hybrid Reinforcement / Supervised Learning of Dialogue Policies from Fixed Datasets. Computational Linguistics 34(4) , 2008.

Work the tutorial is based on:

Verena Rieser. Bootstrapping Reinforcement Learning-based Dialogue Strategies from Wizard-of-Oz data (4.1MB). Ph.D. thesis, Saarland University, Saarbruecken Dissertations in Computational Linguistics and Language Technology, Vol 28, Oct 2008.
Verena Rieser and Oliver Lemon. Learning Effective Multimodal Dialogue Strategies from Wizard-of-Oz data: Bootstrapping and Evaluation. In: Proc. of the 46th Annual Meeting of the Association for Computational Linguistics (ACL/HLT), Columbus, 2008.
Verena Rieser and Oliver Lemon. Does this list contain what you were searching for? Learning adaptive dialogue strategies for Interactive Question Answering. Journal of Natural Language Engineering (special issue on Interactive Question Answering) 15 (1): 55-72, 2008.
Oliver Lemon, Xingkun Liu, Daniel Shapiro, and Carl Tollander. Hierarchical Reinforcement Learning of Dialogue Policies in a development environment for dialogue systems: REALL-DUDE. 10th SemDial Workshop on the Semantics and Pragmatics of Dialogue, (demonstration systems), BRANDIAL 2006.

EACL09tutorial-part4-verena.pdf - on Mar 30, 2009 4:45 AM by Verena Rieser (version 5 / earlier versions)
2152k View Download
EACL09tutorial-part5-verena.pdf - on Mar 30, 2009 4:46 AM by Verena Rieser (version 5 / earlier versions)
288k View Download
eacl09finalOL.pdf - on Apr 6, 2009 8:49 AM by Oliver Lemon (version 1)
2416k View Download

OliverLemon