Time of Flight (ToF) Depth Sensor-based 3D Imaging Architecture for Future Display

With the advancement in 3D display technologies, we anticipate that the next move in the display industries will gear toward autostereoscopy for multiple users. Such a new paradigm will ask for a novel approach to acquiring, processing and synthesizing a real 3D scene at arbitrary viewing directions. As one of the candidates for future 3D imaging technology, Time-of-Flight (ToF) depth camera receives great attention from various researchers and has been adopted in several topics. In this tutorial, we introduce the recent advancement of 3D depth sensing technologies and provide its potential use in 3D imaging for future 3D display. Motivated by recent progress in depth image processing and inverse rendering algorithms, we organize this timely and unique tutorial to introduce basic principles, in-depth discussion on the cutting edge of technical issues, potential ideas, challenges. This tutorial will provide well organized presentations on: the principle of ToF Depth sensor and its sensing architecture issues; the state of the art depth processing algorithms; 3D reconstruction from color and depth images and the lighting and reflectance extraction from color and depth images.

Level

Beginner

Intended Audience

This tutorial will be a good starting point for new researchers in the field of computer graphics who are considering depth image in their work.

Prerequisites

The audience is expected to have taken a basic computer graphics course offered in college.

Presenter(s)

Hyunjung Shim received her PhD and MS degree in Electrical and Computer Engineering from Carnegie Mellon University. She is currently a Research Scientist at the Samsung Advanced Institute of Technology, Samsung Electronics. Her research interests include 3D modeling and reconstruction, inverse lighting and reflectometry, face modeling, image-based relighting and rendering.

Seungkyu Lee received his PhD degree in Computer Science and Engineering from Pennsylvania State University. He was a Research Engineer at the Korea Broadcasting System Technical Research Institute, where he carried out research on HD image processing, MPEG4-AVC and the standardization of Terrestrial-Digital Mobile Broadcasting. He is currently a principal research scientist, Advanced Media Lab at the Samsung Advanced Institute of Technology. His research interests include color and depth image processing, symmetry-based computer vision and 3D modeling and reconstruction.