ECCV 2022 Tutorial
Neural Volumetric Rendering for Computer Vision

Matt Tancik, Ben Mildenhall, Pratul Srinivasan, Jon Barron, Angjoo Kanazawa

October 24, 2022
In-person Afternoon
2pm,

Location: Dan Panorama Hotel, Israel D

Abstract

Neural Radiance Fields (NeRFs), presented in ECCV 2020 just two years ago demonstrated exciting potential for photo-realistic and immersive 3D scene reconstruction from a set of calibrated images. It was followed by a surge of works that explore the potential of using Neural Volumetric Rendering as a technique for enabling many exciting applications and addressing fundamental problems in Computer Vision, Graphics, Robotics and more.
In this tutorial, we will present a short course that approaches Neural Volumetric Rendering from the first principles, including its relation to the history of image based rendering and inverse graphics, its core components and their derivations, common practices, future challenges, and hands-on coding examples. The goal of this half-day tutorial is not to present a series of talks on recent papers in this area, but to provide pedagogical building blocks for novice and intermediate researchers to deeply understand the material by abstracting away the recent developments in the area of Neural Volumetric Rendering.

Course Schedule

All in person.

Please find the links to recordings & slides below! All videos are on this playlist: https://vimeo.com/showcase/10108932


Introduction

2:00 - 2:30: Birds Eye View & Background - Angjoo Kanazawa
Video, PDF, keynote, pptx,

Fundamentals

2:30 - 3:00: Deep Dive into the Volumetric Rendering Function - Ben Mildenhall

Video, PDF, keynote, pptx

3:00 - 3:30: Encoding and Representing 3D Volumes - Matt Tancik

Video, PDF, keynote, pptx

3:30 - 4:00: 30 min break ☕️

4:00 - 4:30: Signal Processing Considerations - Pratul Srinivasan

Video, PDF, keynote, pptx

Application to the real world

4:30 - 5:00: Challenges - Angjoo Kanazawa

Video, PDF, keynote, pptx

5:00 - 5:15: Tutorial - Matt Tancik

Video, PDF, keynote, pptx


Questions: 5:15 - 6:00



Organizers