Central da Copa

This show was exhibited during FIFA World Cup Russia 2018 with the goal of doing a day review of the competition. We worked in a system to allow multiple characters to interact with the main presenter in real-time.  

For the virtual characters, we had actors in another studio equipped with a motion capture system. This studio had tv monitors and audio speakers to allow the actors to see and listen to the main presenter and to perform the requested actions. All the actors movements were captured, processed and applied to the virtual characters that were placed in the main studio's video. There were monitors around the studio and behind the cameras showing the final composition. However, the main presenter used a Magic Leap device that allowed him a better experience with the virtual characters. Besides motion capturing, we also handled real-time camera tracking for four cameras and developed the application for the HMD.

In this project I was responsible for the integration between the camera tracking system and Unreal Engine.