In Wave 1.0, the space is divided into two spaces: one room surrounded by translucent fabric and the other outside of it. Outside, pictures are projected from one and two projectors on the cloth wall and floor, respectively.
The rotating picture on the floor changes the direction and speed of rotation according to the motion of the hand of the hand in the room. The motion is captured via the camera of a laptop in front of the person and sent to the laptop that controls projectors. The capturing and projecting system was driven by Touch Designer.
I engaged in the project "Wave 1.0" as an engineer. I implemented motion capturing to acquire the vertical and horizontal movements of the hands from the video acquired by the webcam using Touch Designer. The acquired values were sent to Touch Designer on another laptop via TCP protocol.