Interactions with Assistive Shopping Robots

organised by:

AkikoYamazaki, Tokyo University of Technology, Japan

Antonia Krummheuer, Aalborg University, Denmark

Michita Imai, Keio University, Japan

Zoom address :

Please open Hopin ,

then go to Stage (on the left menu),

please find the Workshop stage,

and scroll down to see the workshop table with links.

March 7th, 2022

16:00-22:30 (JST) / 8:00-14:30(CET)

Purpose of the workshop

The main goal of this workshop is to establish awareness of the emerging field of socially assistive shopping robots. Simultaneously, it fosters interdisciplinary approaches that combine the development of social robots with a sequential and embodied perspective on mutual processes of understanding in shopping interactions with assistive robots. The workshop will be organized as a mix of invited presentations, individual submissions and, data sessions. Thus, there will be a focus theme covered by the invited speakers from different disciplines, while individual submissions might be allowed to cover the area of assistive shopping robots at large (more information data-session see below).

In this workshop, we will discuss how assistive shopping robots can be informed by ethnomethodology and conversation analysis to anchor the situated and interactional understanding of robot-assisted shopping in HRI. To design and evaluate assistive shopping robots, we must observe humans’ collaborative activities and people’s orientation toward targets such as “place,” “merchandise” on the store/shopping site, and the robots. For vulnerable groups, we must consider their communicative needs to participate in shopping interactions to design robots that can support their shopping activities. As mentioned, initial research in this direction has already been done; however, central questions are still open. These questions include the following:

• How can the sequential and embodied analysis of human shopping interactions inform assistive shopping robots?

• How is assistance and mutual understanding constructed in assistive shopping interactions with and without a robot?

• How can interaction analysis especially be used to understand and inform shopping interactions with assistive robots?

• When, where, and how should a robot engage or be engaged in a shopping interaction?

• How can we account for cultural and linguistic diversity, variation, and difference when designing universal shopping assistive robots?

• Besides interactional aspects, how can contextual aspects be accounted for in the robot/HRI?

Keynote speakers

• Prof. Dirk vom Lehn, King's College, London

• Prof. Yutaka Yamauchi, Kyoto University, Japan

• Prof. Takayuki Kanda, Kyoto University, Japan

Program

Part 1

16:00-16:05 (JST) / 8:00-8:05 (CET) Welcome

16:05-16:25 (JST) / 8:05-8:25(CET) Organizer Talk 1: Akiko Yamazaki and Keiichi Yamazaki, "Sociological robotics and Interactions with assistive shopping robots"

16:25-16:45 (JST) / 8:25-8:45 (CET) Organizer Talk 2: Antonia Krummheuer, "Collaboration and rejection in assisted shopping interaction”

16:45-17:00 (JST) / 8:45-9:00 (CET) Q&A / Discussion

17:00-17:10 (JST) / 9:00-9:10 (CET) Break

17:10-17:50 (JST) / 9:10-9:50 (CET) Keynote Speech 1: Takayuki Kanda, “Social robots in public space" (including Q&A)

17:50-18:30 (JST) / 9:50-10:30 (CET) Keynote Speech 2: Yutaka Yamauchi, “Objectifying Customer's Body: A Study of Employee's Look in Apparel Stores” (including Q&A)

18:30-19:00 (JST) / 10:30-11:00 (CET) Break

19:00-19:40 (JST) / 11:00-11:40 (CET) Keynote Speech 3: Dirk vom Lehn, “Requesting and Offering Price Information: Studying and Learning from Street-Market Interaction for Service Robot Design” (including Q&A)

19:40-20:00 (JST) / 11:40-12:00 (CET) Organizer Talk 3: Michita Imai, “Intention Stance for HRI”

20:00-20:15 (JST) / 12:00-12:15 (CET) Discussion

20:15-20:30 (JST) / 12:15-12:30 (CET) Break

Part 2

20:30-20:45 (JST) / 12:30-12:45 (CET) Presentation 1: Brian Due, Rikke Nielsen, Louise Lüchow,” The smartphone as a ‘socially assistive shopping robot’”

20:45-21:00 (JST) / 12:45-13:00 (CET) Presentation 2: Keiko Ikeda, Keiichi Yamazaki, Akiko Yamazaki, Michita Imai, and Tetsuo Ono,” Elderly support on everyday activities using remotely operated robot: Focusing on a shopping site”

21:00-21:15 (JST) / 13:00-13:15 (CET) Presentation 3: Yuji Miyazaki, Akiko Yamazaki, Keiichi Yamazaki, Kosuke Ogawa, Masaya Iwasaki, and Hideyuki Nakanishi, “Field-of-View Shift Guided by a Robot Clerk”

21:15-21:30 (JST) / 13:15-13:30 (CET) Break

21:30-21:45 (JST) / 13:30-13:45 (CET) Presentation 4: Hirotaka Osawa, Kazuaki Takeuchi, Yoichi Yamazaki, Hiroaki Kato, Taichi Sono, and Kentaro Yoshifuji, ”Cooperative Physical Interaction via Cybernetic Avatar Seller manipulated by People with Disabilities”

21:45-22:00 (JST) / 13:45-14:00 (CET) Presentation 5: Daichi Haginiwa, Hisato Fukuda, and Yoshinori Kobayashi, “Robotic Shopping Trolley that Assist Elderly Users Locally and Remotely”

22:00-22:30 (JST) / 14:00-14:30 (CET) Discussion and Closing

Participation and CfP

Participation in the workshop will provide you with the opportunity to present, discuss and reflect on your research with international and interdisciplinary experts in HRI.

We invite researchers from various fields to submit a 1- to 2-page abstract of the presentation to be delivered at the workshop. Your abstract should address questions related to shopping and assistive robots, with a special focus on combining the development of social robots with a sequential and embodied perspective on mutual processes of understanding in shopping interaction with assistive robots. The abstract should state its research question and describe the robotic platform, application setting and methods and theories used to understand or design shopping interaction with the robots. Accepted submissions will be presented—for about 10 minutes—and discussed during the workshop.

Important dates and sites:

• Abstract Submission: January 31, 2022

• Notifications: February 10, 2022

• Workshop: 16:00-22:30 JST, 8:00 -14:30 CET, 22:00-4:30 PST, March 7, 2022

• Conference website: https://humanrobotinteraction.org/2022/

• Workshop website: https://sites.google.com/edu.teu.ac.jp/hriworkshop/%E3%83%9B%E3%83%BC%E3%83%A0

Organizers and Contact information

Acknowledgements

This workshop is co-sponsored by the JSPS Grant-in-aid for scientific research 20H01585, JST CREST “A Study on Mutual Understanding Computing Based on Simultaneous Contextualization and Interpreting,” and the DFF Research Network “Transition and Sustainability of Communicative Competencies in Interactions Involving Young People with Communication Disabilities” funded by the Independent Research Fund Denmark.