1st International Workshop on Capturing, Interpreting & Visualizing Indoor Living Spaces (CIVILS)

Introduction

With the recent advances in AR/VR recently a wider range of applications such as virtual touring, Building Information Modeling (BIM), e.g. floorplan generation and 3D holistic understanding have been emerging. Such applications have attracted a lot of interest from both academia and industry and motivated a lot of investments in the form of dataset collection, research, publications and products. A few recent examples of such datasets are Zillow Indoor Dataset (ZInD), Apple’s ARKit Scenes dataset and Facebook’s Habitat-Matterport dataset. The size and unique type of annotations provided by each of these datasets provide a huge opportunity for CV/ML researchers to focus on different aspects of scene and environment understanding beyond what was possible before.

Motivated by the recent release of datasets such as Zillow Indoor Dataset (ZInD), Apple's ARKit Scenes dataset and Facebook's Habitat-Matterport dataset, in this workshop we would like to bring industry and academia together and encourage both to focus on specific under explored aspects of environment understanding. We encourage researchers to go beyond "scene understanding" and explore "environment understanding" with a focus on understanding structure through tasks such as 2D/3D room layout estimation, understanding relation of "rooms" for floorplan generation, localization of media within rooms and floorplans, localization of objects within rooms and floorplans. Image, geometric, and semantic information can also be used to reimagine the appearance of home interiors in a photorealistic manner.

Schedule (PST)


12:55am - 1:00pm Chairs' opening remarks

1:00pm - 1:30pm Zillow Research on Floorplan Analysis and Generation Dr. Sing Bing Kang

1:30pm - 2:00pm Location-aware Visual Understanding and Scene Analysis Dr. Hwann-Tzong Chen

2:00pm - 2:15pm Coffee Break

2:15pm - 2:45pm Deep Learning for Indoor Mapping via Egocentric Wearables Dr. Tomasz Malisiewicz

2:45pm - 3:15pm General ingredients of understanding indoor environments Dr. Jana Kosecka

3:15pm - 3:45pm Oral paper presentations

3:45pm - 4:00pm Coffee Break

4:00pm - 4:30pm Towards AI-driven Computer-aided Interior Design Dr. Zihan Zhou

4:30pm - 5:00pm Diffusion Models for Reconstruction, Generation, and Pose Estimation Dr. Yasutaka Furukawa

5:00pm - 5:05pm Chairs' concluding remarks

Time & Location

Time: Sun 18 Jun, 1 p.m. PDT (During CVPR23)

Location: Room East 12

Virtual: Streaming Link