Abstract

Our team at Meta’s Reality Labs Research is developing a production-ready pipeline for creating immersive content using dynamic 3D Gaussian splatting as the underlying format. These techniques have exploded in popularity within graphics research and are gaining traction as intermediate representations in VFX, but a significant gap remains between existing research workflows and the demands of professional production. To close that gap, we chose music videos as a prototyping format that can be short and visually experimental, but with the option to include all the storytelling elements of conventional cinema. We embedded a professional production company, creative director, and musical artist as collaborators in every stage of development as the creative foundation of this process. If we can unlock the full capabilities of this immersive media format, audiences around the world will have the opportunity to see music, sports, and theater from the best seats in the house, visit inaccessible natural environments, or step into purely arts-driven visual creations that never existed before.