To NeRF or not to NeRF

To NeRF or not to NeRF:

A View Synthesis Challenge for Human Heads

Welcome to View Synthesis Challenge for Human Heads @ ICCV2023

Novel view synthesis from multiview images is an essential task in computer vision which involves generating novel images or video sequences from viewpoints that were not present in the original input data. This technique has gained significant importance in recent years due to its diverse applications in areas such as augmented and virtual reality, 3D object recognition and reconstruction, and autonomous navigation. By synthesizing new views from existing ones, computer vision systems can enhance the visual quality of images, create new perspectives of scenes, and even generate realistic 3D models of objects or environments. Therefore, the development of new and improved methods for novel view synthesis from multi-view images is vital for advancing the field of computer vision and unlocking its full potential.

The objective of this challenge is to render novel view images from an unseen view using an input pose, when given a set of 22 (seen view) images and their poses, representing 50 subjects in training. Along with the known images, we provide a corresponding set of masks which result from the image undistortion process – indicating the valid pixels in the image. For the participants convenience, we provide the poses in two common NeRF-based data loader formats: blender and LLFF. While the dataset follows the conventional format for NeRF-based frameworks, we welcome not only neural rendering approaches but also conventional 3D vision/graphics or other innovative methods. Participants can use any combination of the provided dataset. For instance, you can develop a generic model that utilizes multiple subject images for the same view, or you can use subject-specific data to train and render subject-specific validation and test view images. We anticipate methods that overcome the current challenges of novel view synthesis without imposing restrictions on the approaches used.

Please refer to the 'Participation' section for more detail on how to participate the challenge. The challenge is hosted on CodaLab. More content will be added soon, please stay tuned :D

Toy Example of the Imperial Light-Stage Head (ILSH) Dataset

Workshop Program

Oct 2, 2023, Paris, France

Venue: Paris Convention Centre, Pavilion 7, Hall 7.3, @room W06

13:30-13:45 Opening remarks and challenge overview presentation

Invited Talks from Academia and Industry

13:45-14:45 Matthias Nießner

14:45-15:45 Thabo Beeler

15:45-16:00 Short Break

16:00-17:00 Fernando De la Torre

Top-ranked Solutions from the Challenge

17:00-17:21 Challenge winner presentation

17:21-17:35 Additional Baseline presentation

17:35-17:50 Award and close remark

News

09/10/2023: CodaLabs publicly open!! for new Validation [link] and Test [link] submissions.
* Note that you need to follow the process (sign and email the EULA form) to access the training data.
02/10/2023: ILSH Dataset [paper] [bibtex] and VSCHH 2023 [report] [supp] [bibtex] released.
02/10/2023: 'To NeRF or not to NeRF: VSCHH' at ICCV 2023 has been successfully completed.
20/08/2023: Workshop program released!
28/07/2023: Camera-ready template [link] released for final CMT Submission [link].
14/07/2023: Factsheet template [link] released for final CMT Submission [link].
11/ 07/2023: Challenge Phase Dataset link updated [c1] [c2].
13/06/2023: Deadline extended to 19/07/2023 (now, fixed hard deadline).
12/06/2023: Rewards announced for the top three winners: $3000, $2000, and $1000 USD.
12/06/2023: Baseline replication guide updated on Forum page [link].
01/06/2023: Deadline extended to 07/07/2023.
17/05/2023: Baseline using TensoRF updated on leaderboard.
15/05/2023: Challenge opened.

Important Dates:

Challenge open: May 15, 2023, Midnight UTC
- - Development phase ends: July 12, 11:59 p.m. UTC
  - Challenge phase ends: July 19, 11:59 p.m. UTC
Results Submission: July 19, 2023, 11:59 p.m. UTC (Fixed)
Report Submission: July 24, 2023, 11:59 p.m. UTC
Camera-ready Submission: August 04, 2023, 08:59 a.m. UTC
Winner notification: Before workshop
Results paper public review: TBA
Workshop: Oct. 2, 2023 (from 1:30 PM to 6:00 PM)

Note: We will announce the final ranking before the workshop dates. Ranking appearing in the leaderboard will be a temporary ranking, as this can be changed after examining all the code and results by organizers. There will be no more extensions for the result submission.

Workshop Organizers

Youngkyoon Jang

Imperial College London

Jiali Zheng

Imperial College London

Jiankang Deng

Imperial College London

Ales Leonardis

University of Birmingham

Stefanos Zafeiriou

Imperial College London

Challenge Organizers

Zheng Li, Keshuang Li, Jifei Song, Helisa Dhamo, Yiren Zhou, Eduardo Perez Pellitero, Christos Kampouris, Athanasios Papaioannou, Alexandros Lattas, Baris Gecer, Foivos Paraperas Papantoniou, Stylianos Moschoglou, Stylianos Ploumpis, Efstathios Galanakis, Rolandos Alexandros Potamias, Wei Zhang, Youliang Yan, Songcen Xu, Xiaofei Wu, Zhensong Zhang, Di Xu, Minglei Li, Haozhe Jia, Changpeng Yang, Zonghong Dai

Page updated

Google Sites

Report abuse