Development of Audio Haptic Interfaces for Realistic Virtual Reality Experiences

Introduction

In recent years, virtual reality (VR) has become increasingly prominent in fields such as gaming, education, healthcare, and entertainment. While advancements in VR technology have improved user engagement, existing systems often inadequately integrate vibrotactile and kinesthetic feedback with auditory and visual elements, limiting the overall immersive experience. To address this gap, this project aims to develop a prototype that synchronizes visual, auditory, and haptic sensations to enhance the realism of VR. To this end, we will utilize haptic devices employing magnetorheological (MR) fluid technology, enabling users to perceive both vibrotactile and kinesthetic feedback for sensing the texture and weight of virtual objects. For auditory feedback, this project will involve recording real-life sounds, such as the sound of crushing a soda can, and converting these audio signals into corresponding vibrational feedback using an Evaluation Module (EVM). An Arduino platform will facilitate the precise synchronization of audio and haptic outputs during user interactions with VR. The effectiveness of the prototype will be evaluated by analyzing the synchronization of input and output signals, such as audio waves and haptic actuator responses. This research has significant implications for advancing VR technology and its applications across various fields, including healthcare, gaming, and consumer product testing, ultimately contributing to more realistic and interactive virtual environments. 

Objectives

• Develop a haptic dial utilizing magnetorheological (MR) fluids to simulate the tactile response of a rotary knob for virtual reality (VR) applications

• Develop an interactive virtual rotary dial, enabling user input through simulated rotation

• Interface the haptic dial module with the virtual dial