The Interaction Lab is located in the School of Mathematical and Computer Sciences (MACS) at Heriot-Watt University, Edinburgh, Scotland.
We were finalists in the Amazon Socialbot Challenge 2017 and 2018, and in the Amazon SimBot Challenge 2023
Our research is dedicated to advancing the field of conversational AI, Natural Language Processing (NLP), and machine learning to build interactive systems. We focus on developing robust agents that can collaborate adaptively with humans by seamlessly integrating multiple modalities, including speech, graphics, gesture, vision, and Natural Language.
Our approach combines statistical and symbolic information processing, with a strong emphasis on data-driven machine learning and generative AI. The techniques we develop have been applied across a wide range of domains, including:
Conversational assistants (e.g., Alexa, Siri)
Interaction with remote autonomous vehicles and sensors
Healthcare informatics and Human-Robot Interaction (HRI)
We validate our models and algorithms through rigorous evaluation, conducting both simulations and user trials. Our lab's work has received significant recognition, including:
Reaching the finals of the Amazon Alexa Challenge in 2017 and 2018.
Reaching the finals of the Alexa Prize Simbot competition in 2022.
We hosted SIGDIAL 2022 and we organised INLG 2016 , and the 1st Workshop on Data-to-text Generation . We also orgainsed the workshop on Spatial Reasoning and Interaction for Real-World Robotics at IROS 2015 and the 2018 SICSA workshop on Conversational AI.
Check out our new Masters course in AI and Conversational Agents (MSc in AI with Speech and Multimodal Interaction). Many of us also collaborate in the Human-Robot Interaction group and the HWU NLP lab. We also organised the 2017 Year of Robotics at Heriot-Watt. We also collaborate with the National Robotarium.
We also organise a Seminar Series.
8 papers accepted at EMNLP 2024
Personal AI Assistants: IEEE Spectrum article 2023
Oliver Lemon talks about Gato AI in New Scientist, May 2022
We hosted SIGDIAL 2022 !
We are the only European team selected for the Alexa Prize SimBot competition in 2022
Several papers accepted at EMNLP, ACL, EACL ,ICMI, HRI 2021
4 papers accepted at ACL 2020 !
BBC News 2020: SPRING project
2 RA positions available (oct 2019): apply here and here
New EPSRC ORCA Hub funded : ORCA.
We are through to the 2018 Amazon Alexa Challenge finals!
Best paper award at Robo-NLP 2017
Oliver Lemon is a keynote speaker at SIGDIAL 2017
Yannis Konstas will be joining our group as an assistant professor!
Our team was chosen by Amazon to enter the Alexa challenge!
Job opening with closing date 27 June 2016.
Pepper robot has arrived! (June 2016)
Papers accepted (2016): AAMAS, HRI, ACL, SemDial, LREC, FUZZ-IEE, IWSDS, SemEval, CSL, ECAI, SIGDIAL, RO-MAN, INLG.
Eshrag Refaee and Verena Rieser are winners of SemEval'16 challenge (sub-task 7)
Horizon 2020 project on socially intelligent robots (MuMMER) starting in 2016! Postdoc positions here
New ESPRC project (2015) funded on domain-general spoken dialogue systems: BABBLE
January 2015: FurHat has arrived!
SpeechCity wins the Culture and Sports Challenge in the EdinburghApps competition.
2 new EPSRC projects on NLG funded
SpeechCity demo app released for SEMDIAL 2014
ECHOES project rated "outstanding" by ESRC (June 2014)
The Interaction lab is jointly organising a workshop on Multimodal HRI at ICMI 2014
BBC article on Parlance project, "How to turn Siri into Samantha", Feb2014
JAMES project: on german TV, 2014
SemDial'14 is hosted by iLab.
MSc in AI with Speech and Multimodal Interaction starting Sept 2014.
Welcome to Katrin Lohan, our new lab member (21/10/13)
2 papers accepted for ICMI 2013
5 papers accepted for SIGDIAL 2013
Jason Williams from Microsoft Research visited us on 14/6/13
Oliver Lemon joins Advisory Board for Dialog State Tracking Challenge II (2013 -)
ENLG 2013 paper accepted.
Oliver Lemon gave an invited talk at Nuance Communications Inc, Sunnyvale Research Lab on 29/5/13
Verena Rieser is area chair for discourse & dialogue for EACL'14.
Verena Rieser gave an invited talk at ICSI Berkeley on 14/07/13. Watch on YouTube.
Mary Ellen Foster's paper with Ron Petrick from Edinburgh Uni has been named Novel Applications Track Best Paper for ICAPS'13.
2 papers accepted for ACL 2013
25/3/13 Verena Rieser elected to the Scientific Advisory Committee of SIGDIAL
Jan 2013: Verena Rieser elected to the board of SIGGEN
6/11/12: SpaceBook and JAMES at the SICSA DemoFest
1/11/12 New book:
ECHOES project: video
Human-Robot Interaction: VIDEO
May 2012: call of the wired: Conversational Interface work at HWU and Cambridge
Book published: Rieser & Lemon "Reinforcement Learning for Adaptive Dialogue Systems"
New project EC FP7 Parlance started November 1st.
See here for details
@ParlanceProject
New forum for recruiting subjects at Heriot-Watt. Website here
@ParticipateHW
3/11/11 Invited talk introducing Machine Learning to medics and psychologists at the Western General Hospital. Slides Available here.
1/11/11 Verena Rieser joined as a new faculty member.
1/11/11 ECHOES project at ESRC Festival of Social Science
Trialling a new spoken dialogue system for Edinburgh restaurants. ABC SDS prize draw.
Dialogue data released from CLASSiC project in our archive.
Heriot-Watt has been named as Scottish University of the Year 2011/12 by the Sunday Times.
Hosting SICSA workshop on Affective Interaction and Virtual Characters, 17 June 2011
Special issue of ACM TSLP on adaptive dialogue is out now!
2 papers accepted for SIGDIAL 2011
New projects James and Spacebook kick off this month (March 2011).
Outreach activity (4/3/2011): Tommy the Robot visits local school.
New project Help4Mood kicks off (January 2010).
ECHOES project features in "Britain in 2010" magazine (p. 94)
Interaction Lab joins the Vision and Language Network (Feb 2010)
The new Interaction Lab at Heriot-Watt up and running (posted 9/10/09).