To recognize a person's hand over a cloud, we used ofOpenCV that recognizes blobs, and for the animation we used the ofTweener library.
Dynamic SoundCloud Installation is a project by Roy and Rosen. For this assignment we were inspired by the online service SoundCloud . It lets its users interact with the musical content by placing comments on a visual representation of this content (i.e.- a waveform). Those comments are stored and appear when the song is playing.
This installation came from our idea of having a physical representation of SoundCloud that you can interact with via simple gestures and several keyboards. A user can look up a song and the results would appear in the form of little clouds that he can either select for a single play or arrange in a playlist. To do that one could use certain simple gestures like moving his hand on a cloud or moving clouds in a column. However, to achieve that we would have needed SoundCloud's web content. That was not possible, hence we decided to focus on a single part of this idea.
As one can see from the video, we focused on the idea of comments and direct interaction with the audience. We built a visual representation of SoundCloud, which had also the signature waveform visualization of the service. However, instead of popping out, comments appeared in the form of raining comment boxes. People that want to interact with the current song could just lay their hand over the cloud and a box for commenting will appear. We further thought of the possibility for multiple commenting in the same time, thus to have several keyboards and when a person lays their hand on the cloud he would be sent to the appropriate vacant keyboard.