W5: Affective Haptics as a Direct Link to Emotion
We discuss the new possibilities of Affective haptics based on the emerging needs and seeds. The link from haptics to brainstem is still an uncultivated area in science, but we are beginning to have tools to clarify it. Technological mental support and encouragement using the link are recent strong needs of people. In this workshop, top-tier researchers from medical to application fields are invited.
This workshop is supported by JST CREST Symbiotic Interaction.
July 9, 2019
9:00-9:30 Opening: Affective Haptics as a Direct Link to Emotion (Hiroyuki Shinoda, University of Tokyo, organizer)
9:30-10:00 The Affective Dimensions of the Cutaneous Rabbit Effect (Mounia Ziat, Bentley University)
10:00-10:30 Haptic Characteristics in Human Behavior through Neural Network Estimation (Yasutoshi Makino, University of Tokyo)
10:45-11:15 Artificial Bodily Reactions via Haptic Feedbacks for Evoking Emotion (Takuji Narumi, University of Tokyo)
11:15-11:45 Neuro-Imaging and Neuro-Modulation of Somatosensory Information and Phantom Limb Pain (Takufumi Yanagisawa, Osaka University)
11:45-12:15 Social Touch in Human-Robot Interaction (Masahiro Shiomi, ATR)
The Affective Dimensions of the Cutaneous Rabbit Effect (Mounia Ziat, Bentley University)
With the emergence of head-mounted displays for virtual or augmented reality, there is a need in creating new haptic technologies that contribute to the enhancement of user's immersion. During the design process, it is not sufficient only to focus on the reproduction of mechanical stimuli. It is also crucial to integrate emotional and social aspects of touch for a fully immersive experience. In this talk, I will present the findings of two studies in which we assessed the emotional dimensions of touch by exposing participants to visual images of saltatorial animals. The aim is to overcome technological challenges through better knowledge of the workings of the emotional brain.
Haptic Characteristics in Human Behavior through Neural Network Estimation (Yasutoshi Makino, University of Tokyo)
Human body movements contain a variety of information, from which we can obtain information about what we touch. For example, in pantomime, a light bag looks heavier when the performer moves in a certain way. By learning the relationship between body movement and the tactile properties of an object, a machine can also estimate the tactile information of the object from human movement. We show some examples of such studies and discuss the possibility of estimating emotional aspects from human movements.
Artificial Bodily Reactions via Haptic Feedbacks for Evoking Emotion (Takuji Narumi, University of Tokyo)
Recent cognitive studies revealed that emotion is evoked through the cognition and identification of the change in our body such as bodily reactions, and our perception of the body consists of multi-sensory integration. These findings suggest that haptic feedbacks which make us feel as if our bodily reactions evoke affects our emotion. In this talk, I will present examples of affective interfaces which can evoke emotion and affect our decision, action and cognitive abilities via the emotional change.
Neuro-Imaging and Neuro-Modulation of Somatosensory Information and Phantom Limb Pain (Takufumi Yanagisawa, Osaka University)
Neuro-imaging techniques reveal how tactile stimulation changes brain activities. It remains difficult, however, to induce or control natural perceptions by neuromodulation. Phantom limb pain is pain after limb amputation or deafferentation, and although the patients have lost sensation in the limb, they still feel its existence with uncontrollable pain. We have succeeded in controlling this pain by inducing cortical plasticity using a brain–machine interface. I will discuss how somatosensory information is represented in the brain and controlled to modulate phantom limb pain.
Social Touch in Human-Robot Interaction (Masahiro Shiomi, ATR)
Physical embodiment of social robots enables them to realize active social touch interaction, which plays an essential role in human-human interaction. We aim to develop a mechanism for safe and trustworthy social touch interaction between human and robots. In this presentation, I will introduce about our CREST project, “Computational Social Touch for Symbiotic Human-Robot Interaction” and its latest progress, such as a fabric touch sensor, a huggable robot, a social touch display and so on.
Affective support by haptics is one of the emerging needs. The term affective haptics here includes technologies that change/motivate the human behavior using the emotional effect.
People use the modality of haptics to control the emotion. Skin-ship to children is acknowledged to be indispensable for the healthy growth of the children. Massage can reduce the stress, and a nurse in a hospital touches a patient’s back to relax the patient in various treatments. There seem some direct and strong links from the haptic perception to brainstem, which can control hormones and neurotransmitters as oxytocin, endorphin or dopamine. But the links are still practical wisdoms in many cases, and not approached scientifically.
Recent haptic technologies are making it possible to provide haptic stimulation in daily life. Various wearable devices can produce whole body stimulation, and midair device can create comfortable feeling on a skin. Machine learning technology enables such physical stimuli to be incorporated in the feedback loop of the active human motion in various contexts. These technologies are effective tools to study and utilize the link between haptics and emotion.
The core problem is the link from haptics to brainstem, and it is an uncultivated area in science. Technological mental support and encouragement are recent strong needs of people.
The approach is not limited to analytical ones based on physiological indicators. Synthetic approach (design approach) is also a practical and effective way. Finding good examples that attract people, move emotions, and lead mental improvements assists the understanding and facilitates the applications.
In this workshop, we discuss this theme from the viewpoints of technologies, brain sciences, informatics, and industrial applications.