Nom Verbal Information Applied to a Receptionist Robot
This work is motivated by our desire to have a robotic receptionist able to understand a person through verbal and nonverbal information. In the receptionist services domain, the human-human interaction involves not only the exchange of verbal information, but also includes nonverbal information, such as the receptionist’s memories about who that person is, or how often that person went through, or his/her most common question. Even information about the emotional state of the person can be used by the receptionist to provide the best experience on the current and next interactions. We believe this scenario will be the best for human-robot interaction as well.
This project has a strong influence of CMU's Receptionist and Gamebot. Many Thanks to Dr Reid Simmons
There are several information we can give, but it is interesting to see what we have now on the following videos
Version of June 2017 - The systems operating in a long term evaluation
The video presents the version as of June 2017. In the left side appears the receptionist interface, in the central region what is detected by the voice recognition system, and on the right the 3D Camera 3D, where it can be seen user's information. In the botton right it can be seen a person interacting with the system.
Examples contained in the video
- what is the extension of Josue ? (In Portuguese - Qual é o ramal de Josue) in the beginning
- Then at 0:32, What is a Cat ? ( O que é gato?) A knowledge that is not inside the project's knowledge base
- Then at 0:50, How is the traffic in Campinas? (Como está o transito em Campinas ?), A knowledge that is not inside the project's knowledge base
- Then at 1:07, it can be seen the avatar visualy following the person.
- Then at 1:29, it can be seen the system mirroing the users expressions, say person with a happy face the avatar will have a happy face and then a person with a bad face then the avatar will have a bad face.
Other Results:Other Results
Previous Results:
• Video 1: “What's the extension number?”
• Video 2: “Managing Emotions in the Workplace” - Capturando emoções básicas do usuário.
• Video 3: “Conceptual Questions Using Ontologies” http://bit.ly/anatest3 ◦ Interação verbal com o robô utilizando ontologias para responder as perguntas do usuário.
• Video 4: “Managing Message Box” http://bit.ly/anatest4 ◦ Deteção de face e reconhecimento facial e voz para serviço de caixa de mensagens.
• Video 5: “Nonverbal Communication - Tracking The Workplace's Mood” http://bit.ly/anatest6