Seminar and Workshop
Listening Through the Body:
Combining Visual, Auditory, and Haptic Interaction
For Designing a Concert Space for XR 

Music serves as a collective experience, significantly influencing culture, the economy, and society. What does the future hold for music consumption and concerts? Historically, we have transitioned from physical formats like CDs and tapes to streaming, and we may now be on the brink of virtual reality (VR).

The key question is how music and live performances will evolve. In the past and present, we have depended on being physically present, but the pandemic has accelerated the shift to virtual concerts via VR. A notable example is BlackPink, which hosted a concert last year that attracted 280,000 paying viewers, generating 10 billion won in revenue and connecting with fans across 10 countries.

Despite their potential, VR concerts encounter various obstacles. They frequently lack engagement and can lead to solitary experiences. Instead, we propose the concept of mixed reality concerts, where both participants and spectators can be present either remotely or physically, merging the tangible and virtual worlds. To bring this vision to life, we are concentrating on developing a digital mixed reality experience for both musicians and audiences through mixed reality graphics. Additionally, we intend to gather biometric data from the audience to map music or visual parameters and provide haptic feedback between musicians and the audience.