Program

Invited Speakers

Invited talks will feature diverse topics within the area of multimodal sensor understanding, including the state-of-the-art modeling approaches, new datasets, privacy and ethical concerns around wearable sensors, etc.

Schedule

Date and Time: June 10th 2023, 2:00 – 5:30 PM (local time)

Location: Delphi Amphitheater

The workshop will feature invited talks, poster sessions and oral presentation sessions. 

More detailed schedule for the workshop is as follows.

Oral Session 1 (Chair: Seungwhan Moon)

• 2 - 2:10 PM: Introduction and Opening Marks (Presenter: Seungwhan Moon)

• 2:10 - 2:40: Keynote Talk 1: "Multimodal Embodied Models: Enabling Embodied Artificial Agents to Act and Reason Using Multimodal Perception" (Presenter: Alessandro Suglia)

Poster Session (Chair: Seungwhan Moon & Claudio Gallicchio)

• 2:40 - 3:30: Poster Session (All Accepted Authors)

• 3:30 - 4:00: Coffee Break

Oral Session 2 (Chair: Claudio Gallicchio) 

• 4:00 - 4:30: Keynote Talk 2: "Tiny Sensors: What future for them ?" (Presenter: Danilo Pau)

• 4:30 - 4:45: Oral Presentation 1: "A Dataset for Foreground Speech Analysis with Smartwatches in Everyday Home Environments" (Presenter: Dawei Liang)

• 4:45 - 5:00: Oral Presentation 2: "A CRNN-GCN Piano Transcription Model Based on Audio and Skeleton Features" (Presenter: Wei Xu)

• 5:00 - 5:30: Keynote Talk 3: "Visual Learning of Sounds in Spaces" (Presenter: Kristen Grauman)

• 5:30: Closing Remarks (Presenter: Claudio Gallicchio)

Please also refer to the tentative conference program here.

All Accepted Papers

The list of all accepted papers is as follows.

• "A Dataset for Foreground Speech Analysis with Smartwatches in Everyday Home Environments"
  Dawei Liang (UT Austin)*; Zifan Xu (University of Texas at Austin); Yinuo Chen (UT Austin); Rebecca Adaimi (UT Austin); David Harwath (The University of Texas at Austin); Edison Thomaz (The University of Texas at Austin)

• "A CRNN-GCN Piano Transcription Model Based on Audio and Skeleton Features"
  Yuqing Li (Huazhong University of Science and Technology); Xianke Wang (Huazhong University of Science and Technology); Ruimin Wu (Huazhong University of Science and Technology); Wei Xu (Huazhong University of Science and Technology)*; Wenqing Cheng (Huazhong University of Science and Technology)

• "Prediction of Driver's Stress Affection in Simulated Autonomous Driving Scenarios"
  Valerio De Caro (University of Pisa)*; Herbert Danzinger (AVL List Gmbh); Claudio Gallicchio (University of Pisa); Clemens Könczöl (University of Graz); Vincenzo Lomonaco (University of Pisa); Mina Marmpena (Information Technology for Market Leadership); Sevasti Politi (Information Technology for Market Leadership); Omar Veledar (Graz University of Technology); Davide Bacciu (Univeristy of Pisa)

• "A SURVEY OF DATASETS, APPLICATIONS, AND MODELS FOR IMU SENSOR SIGNALS"
  Aparajita Saraf (Meta AI)*; Seungwhan Moon (Meta AI); Andrea Madotto (Meta AI)

• "Ambient Sleep Quality Analysis with A Machine Learning Model"
  Mehmet F Bagci (San Diego State University & University of California San Diego)*; Truong Nguyen (UC San Diego); Yusuf OZTURK (San Diego State University)

• "HUMAN ACTIVITY RECOGNITION FROM MOTION AND ACOUSTIC SENSORS USING CONTRASTIVE LEARNING"
  Rui Zhou (The University of Hong Kong)*; Running Zhao (The University of Hong Kong); Edith Ngai (The University of Hong Kong)

• "A Health Profiling Framework for Children Leveraging Multimodal Learning Based on Ambient Sensor Signals"
  Zhihan JIANG (The University of Hong Kong)*; Cong Xie (Tencent); Edith Ngai (The University of Hong Kong)

• "DEVELOPMENT OF A PAIN SIGNALING SYSTEM USING MACHINE LEARNING"
  Helen Korving (Vrije Universiteit Amsterdam)*; Di Zhou (School of Design Arts and Media, Nanjing University of Science and Technology); Sheng Li (National Institute of Information & Communications Technology (NICT)); Paula Sterkenburg (Vrije Universiteit Amsterdam); Panos Markopoulos (Eindhoven University of Technology); Emilia Barakova (Eindhoven University of Technology)

• "Symbiotic Artificial Intelligence: Order Picking and Ambient Sensing"
  Zhe Ming Chng (Georgia Tech); Calix Tang (Georgia Tech); Darshan Krishnaswamy (Georgia Tech); Haoyang Yang (Georgia Tech); Shivang Chopra (Georgia Tech); Jon G Womack (Georgia Tech)*; Thad Starner (Georgia Tech)

• "Multimodal Estimation of Change Points of Physiological Arousal during Driving"
  Kleanthis Avramidis (University of Southern California)*; Tiantian Feng (University of Southern California); Digbalay Bose (University of Southern California); Shrikanth Narayanan (USC)

• "AI-Toolkit: a Microservices Architecture for Low-Code Decentralized Machine Intelligence"
  Vincenzo Lomonaco (University of Pisa)*; Valerio De Caro (University of Pisa); Claudio Gallicchio (University of Pisa); Antonio Carta (University of Pisa); Christos Sardianos (Qatar University, Harokopio University of Athens ); Iraklis Varlamis (Harokopio University of Athens); Konstantinos Tserpes (Harokopio University of Athens); Massimo Coppola (CNR); Mina Marpena (ITML); Sevasti Politi (ITML); Erwin Schoitsch (AIT); Davide Bacciu (Univeristy of Pisa)

• "Smart Selection of Useful Insights from Wearables"
  Allmin Susaiyah (Philips)*; Aki Harma (Philips); Simone Balloccu (University of Aberdeen); Ehud Reiter (); Milan Petkovic (Technical University of Eindhoven)

• "ENHANCING HUMAN ACTIVITY RECOGNITION THROUGH SENSOR FUSION AND HYBRID DEEP LEARNING MODEL"
  Adane N. Tarekegn (Norwegian University of Science and Technology (NTNU))*; Mohib Ullah (NTNU); Faouzi Alaya-Chekh (NTNU at Gj�vik, Norway); Muhammad Sajjad (NTNU)