Prof. Koki Nagano
Principal research scientist at Nvidia Research, USA.
Biography: Prof. Nagano works at the intersection of Graphics and AI with focus on achieving realistic digital humans using data-driven techniques and deep learning. He worked on a 3D display that allows an interactive conversation with a holographic projection of Holocaust survivors to preserve visual archives of the testimonies for future classrooms. His work on skin microgeometry synthesis has helped create digital characters in blockbuster movies such as “Ready Player One” and “Blade Runner 2049” as well as the open source ones such as “Digital Mike” and “Digital Emily 2.0”. His work on photorealistic human digitization has been shown in places including World Economic Forum, EmTech, TEDxCharlottesville, and SIGGRAPH Real-time Live!. His work has also led to the development of the state of the art Deepfake detection technology in collaboration with top media forensics experts. He obtained his PhD from the University of Southern California advised by Dr. Paul Debevec at USC ICT and his BE from the Tokyo Institute of Technology.
Keynote Title: TBD
Time: 8:30 – 9:15
Abstract
TBD
Research Center for Advanced Science and Technology, The University of Tokyo
Team Director, RIKEN AIP
Vice Director, Research Center for Medical Bigdata, National Institute of Informatics, Japan
Biography: Prof. Harada is a Professor at the Research Center for Advanced Science and Technology, The University of Tokyo. His research interests include visual recognition, machine learning, and intelligent robots. He received his Ph.D. from The University of Tokyo in 2001. He is also a Team Director at RIKEN AIP and Vice Director of the Research Center for Medical Bigdata at the National Institute of Informatics, Japan.
Keynote Title: Real-Time Controllable and Animatable Head Avatars
Time: 10:15 – 11:00
Abstract
Head avatar reconstruction has important applications in virtual reality, online conferencing, gaming, and the film industry, and has attracted significant attention in the field of computer vision. The fundamental goal of this area is to faithfully reconstruct a person’s head and enable precise control over facial expressions and head poses.
In this talk, Prof. Harada will introduce a framework for reconstructing a 3D head avatar from one or multiple images in a single forward pass. He will also present an autoregressive model that enables real-time generation highly synchronized with speech, including lip movements, realistic head poses, and blinking, as well as a talking-head generation framework that allows independent control of style and emotion.