ACM CHI2021 Workshop:
Human Augmentation for Skill Acquisition and Skill Transfer (HAA2021)
13:00-17:00 (JST), May 8, 2021
collocated with The ACM CHI Conference on Human Factors in Computing Systems
Embedded Files
Instructions for workshop attendee:
If you want to attend the workshop, please follow the instructions below.
https://docs.google.com/document/d/14ttzBnhNnnv_6B2HaxUJbsOyqbYUbc1a3g7HdgYaC4s/edit?usp=sharing
Abstract:
Abstract:
Human augmentation or augmented humans is regarded as an important research field with a view to the future society in which computer technology such as Virtual and Augmented Reality, Artificial Intelligence, Computer Vision, Robotics, etc. are highly integrated. Human augmentation is not just a research to make human much stronger. It should be used to assist people’s daily activities. For example, it can be used to teach sports or musical performances more effectively. It can be used even for assisting people with disabilities. This workshop is expecting novel research results or late breaking results on designs, methods, implementations, or applications to augment or enhance human ability, in physical and intellectual, by using advanced technologies of VR/AR, AI, CV, and Robotics.
Keynote Speaker:
Prof. Dr. Yusuke Sugano, The University of Tokyo
Yusuke Sugano is an associate professor at the Institute of Industrial Science, The University of Tokyo. His research interests focus on computer vision and human-computer interaction. He received his Ph.D. in information science and technology from the University of Tokyo in 2010. He was previously an associate professor at the Graduate School of Information Science and Technology, Osaka University, a postdoctoral researcher at Max Planck Institute for Informatics, and a project research associate at the Institute of Industrial Science, the University of Tokyo.
https://www.yusuke-sugano.info
Program Schedule (JST Time Zone):
Program Schedule (JST Time Zone):
[13:00] Opening
[13:10-13:30] Keynote talk:
Users-in-the-loop Design and Research for Inclusive Machine Learning Applications
Professor Yusuke Sugano, The University of Tokyo
[13:30-13:40] Short break
[13:40-14:20] Session 1: Advanced technologies for skill acquisition and transfer
PoseTuner: Sonification Based Fine-Tuning of Pose with Unsupervised Learning [Paper]
Takuya Hara, Hirotaka Hiraki, Naoki Kimura, Hiromi Nakamura and Jun RekimotoSynergyFlow: Sonification of Muscle Synergy for Motor Skill Acquisition [Paper]
Kentaro Hayashi and Jun RekimotoDeepStabilizer360: Stabilizing 360 videos using Deep Neural Network [Paper]
Dong-Hyun Hwang, Dong-gyun Kim and Hideki KoikeChoreographic Interfaces: Wearable Approaches to Movement Learning in Creative Processes [Paper]
Ozgun Kilic Afsar, Hila Mor, Cedric Honnet, and Prof. Hiroshi Ishii
[14:20-14:30] Short break
[14:30-15:10] Session 2: Case studies in sports
GolfPlan: Learning Swing, Pose and Motion Retargeting From Videos [Paper]
Hui-Shyong Yeo and Hideki KoikeA Feature Extraction Method for Classifying Beginner and Expert skier on a Ski Simulator using Deep Learning [Paper]
Ryosuke Atsumi, Hideaki Kanai, Erwin Wu and Hideki KoikeA Simple Visual Feedback Method for Virtual Tennis Training System to Accelerate Repetitive Practice [Paper]
Gaku Ishimoto and Kentaro FukuchiMixed Reality Table Tennis System with "True" Haptic Feedback [Paper]
Mitski Piekenbrock, Erwin Wu, Takuto Nakamura and Hideki Koike
[15:10-15:20] Short break
[15:20-16:00] Session 3: Case studies in music
Educational Audio VST Effect Programming [Paper]
Christopher Mitcheltree and Hideki KoikeHigh-resolution sensing of the piano key motions for characterizing motor virtuosity of expert pianists [Paper]
Takanori Oku and Shinichi FuruyaPrecise Hand Pose Data Collection for Piano Players [Paper]
André Jonas, Erwin Wu, Shio Miyafuji and Hideki KoikeVisualization of Speech Differences for Dialect Speech Training [Paper]
Kazuki Kawamura and Jun Rekimoto
[16:00-16:10] Short break
[16:10-16:50] Session 4: Case studies in medicine
Prolonged Aftereffect of Sensorimotor Adaptation to Gradually Increased Joint Resistance through a Wearable Robotic Device Controlled by Magneto-Rheological Fluid [Paper]
Seitaro Iwama, Masatoshi Kokubo and Junichi UshibaA Gauze Suture Practice System for Neurosurgery [Paper]
Shio Miyafuji, Mikihito Matsuura, Erwin Wu, Satoshi Kiyofuji, Taichi Kin, Takeo Igarashi and Hideki KoikeBrainBraille: Towards an Automatically Trained Text Entry System for Brain Computer Interfaces [Paper]
Yuhui Zhao, Thad Starner, Caitlyn Seim and Melody Jackson
[16:50] Closing
Background:
Background:
Human augmentation or augmented humans is regarded as an important research field with a view to the future society in which computer technology such as Virtual and Augmented Reality, Artificial Intelligence, Robotics, etc. are highly integrated.
One of the main motivations of human augmentation is to strengthen the people with a help of advanced technologies. There is a powered suit such as HAL by CYBERDYNE Inc. as a representative human augmentation technology. This is used to carry heavy objects that human cannot possess or to complement the lost body functions due to injuries and diseases.
On the other hand, there is another aspect in human augmentation which makes the human itself stronger by supporting he or she acquires special skills faster and more effectively.
The advanced skills of top athletes, elite music performers, or people with disabilities are acquired by many years of training and experience. It is difficult to externalize such skills, and therefore it is difficult to transfer the skills to others. For example, in sports science, it is possible to measure body motion using the latest equipment such as special video equipment, small sensors, etc. However, the feedback to the athlete is limited to video playback after training and presentation of the measurement data. It is desirable that the coach intervenes in real time during training, and teach how to use the body, gaze direction, or psychological guidance etc.
In this workshop, we aim to discuss the technologies and case studies of skill acquisition support system that acquires (i.e. copies) advanced skills from people and transfers (i.e. pastes) them to others using computer vision, virtual and augmented reality, robotics, and artificial intelligence.
In particular, we want to discuss the following 4 topics:
Advanced technologies for skill acquisition and transfer:
First, we want to discuss the advanced technologies that copy the skills using computer vision, machine learning, and device technologies, and paste the skills using VR/AR or Robotics technologies.
Case studies in sports:
Next, we want to discuss human augmentation systems in sports domain including advanced sports science, cyber training systems.
Case studies in music:
Third, we want to discuss human augmentation systems in music domain including coaching systems for musical instruments.
Case studies in medicine:
Finally, we want to discuss human augmentation systems in medicine including rehabilitation systems, surgery training systems.
Call for Participation:
Call for Participation:
We invite position papers for the CHI2021 Workshop on "Human Augmentation for Skill Acquisition and Skill Transfer". This half-day workshop will offer an interdisciplinary forum of discussion for both academics and industries.
Researchers and developers are invited to submit a position paper (2 pages, double column, CHI format (references excluded)) of within the scope of challenges for Human Augmentation for Skill Acquisition and Skill Transfer. In particular, we are expecting, but not limited to, the following topics:
Computer visions for acquiring skills
Visual/audio/haptic feedback for transferring skills
Deep Learning for skill abstraction
Systems and case studies in sports training
Systems and case studies in music training
Systems and case studies in rehabilitation
All submissions are reviewed based on the relevance and the quality of the position paper by the workshop organizers. When accepted, each participant will upload his/her presentation video up to 5 minutes describing his/her work and will attend the session for Q\&A and discussion.
At least one author of each accepted paper must register for the workshop and all participants must register for the workshop and at least one day of the conference.
Please submit your paper via easychair system.
https://easychair.org/my/conference?conf=haa2021#
All accepted submissions to the workshop will be public on the website. Moreover, we plan to publish all the accepted papers using ACM International Conference Proceedings Series (ICPS).
Important dates:
Important dates:
Submission deadline (Jan. 26, 2021) -> Extended to Feb. 2nd, 2021 (AOE) !Notification date (Feb. 9, 2021)Camera ready due (Feb. 16, 2021)Workshop date (May 8, 2021)
Organizers:
Organizers:
This workshop will be organised by an interdisciplinary team of researchers all of which are currently actively working in the field of Human Augmentation.
Hideki Koike is a Professor at Tokyo Institute of Technology. He has been working on information visualization of huge data, projector-camera systems, vision-based HCI such as interactive surfaces, and digital sports such as camera-embedded balls. He is currently leading a Japanese Government funded JST CREST project entitled "A Study on Skill Acquisition Mechanism and Development of Skill Transfer Systems".
Jun Rekimoto is a Professor at the University of Tokyo. His research interests include human-computer interaction, computer augmented environments and computer augmented human (human-computer integration). He invented various innovative interactive systems and sensing technologies. He also elected to ACM SIGCHI Academy.
Junichi Ushiba is an Associate Professor at the Department of Biosciences and Informatics, Faculty of Science and Technology, Keio University, Japan. Dr. Ushiba's research interests are focused on Brain-Machine Interface to guide brain plasticity as neurological rehabilitation. He takes computational, neuroimaging, and electrophysiological approaches to assess sensorimotor functions in the brains with medical quality.
Shinichi Furuya is a researcher at Sony Computer Science Laboratories Inc., where he leads the Music Excellence Project that aims at enhancing expertise of expert musicians by combining principles of the brain and body and technologies that assess and improve sensorimotor skills.
Asa Ito is an Associate Professor at Tokyo Institute of Technology. Research specialty is in aesthetic and contemporary art. She also has been studying people with disabilities and published many books including "How Blind People See the World", "Body Theory of Blind Athlete".
Program Chair
Dong-Hyun Hwang (Tokyo Institute of Technology)
Page updated
Google Sites
Report abuse