Everybody listens to music. With the power of virtual reality, the music listening experience can be transformed into a more immersive one. Synesthesia is a VR application that stimulates the sense of vision, taking you to a new world when listening to music.
We wanted to build an immersive VR music environment in which the user will be able to experience the visual effects. The user will first be presented with a user interface to help user select various variables from the scene, such as dancer models and songs. The main scene consists of a dome structure with concrete floors, along with immersive spheres that glow and change size based on the music input. This occurs using a Fast Fourier Transform, which allows us to isolate frequencies of audio input. Variables will be passed from the user interface scene to populate different models with different music. We also integrated fancy skin effect and customized dance animation to make the model looks more dynamic and cool. There is also a menu bar for the scene to let user interact with the application easily. Player will feel immersed not only from audio displays, but also visual displays and haptic responses. In the future, we plan on expanding our product by including a social element -- users can make playlists with their friends, and experience that playlist together in the same virtual environment.
Start menu for user to select models and music from the Interface. User can pick the number of dancer for each model, select different dancers and select music from the list!
The game scene is combined of visual effect to increase the user experience when listening to music. Different features like lighting and dancer's animation will provide them with an immersive environment.
Different color light represents different band of music that provide a dynamic virtual effect for the user.
Addition to the animation for each dance, we also added skin mesh effect to each dancer.
The combination of the dancer and lighting will provide user with an immersive visual music environment.
We are focusing on implementing our product for the Oculus Quest as of now. After our product is more built up, we will look into expanding for other devices.
Vinod Krishnamurthy
CS '20
Will Krasnoff
CM '20
Ross Liu
CS '20