Hyperbolic Deep Learning for Computer Vision

Introduction

Learning in computer vision is all about deep networks and such networks operate on Euclidean manifolds by default. While Euclidean space is an intuitive and practical choice, foundational work on non-visual data has shown that when information is hierarchical in nature, hyperbolic space is superior, as it allows for an embedding without distortion. A core reason is because Euclidean distances scale linearly as a function of their norm, while hyperbolic distances grow exponentially, just like hierarchies grow exponentially with depth. This initial finding has resulted in rapid developments in hyperbolic geometry for deep learning.

Hyperbolic deep learning is booming in computer vision, with new theoretical and empirical advances with every new conference. But what is hyperbolic geometry exactly? What is its potential for computer vision? And how can we perform hyperbolic deep learning in practice? This tutorial will cover all such questions. We will dive into the geometry itself, how to design networks in hyperbolic space, and we show how current literature profits from learning in this space. The aim is to provide technical depth while addressing a broad audience of computer vision researchers and enthusiasts.

Schedule [June 19th - West 116-117]

9:00 - 9:30 Introduction and overview of the field (Pascal Mettes)

9:30 - 9:40 Break

9:40 - 10:10 How do we build hyperbolic neural networks? (Max van Spengler)

10:10 - 10:20 Break

10:20 - 10:50 What is hyperbolic geometry? (Yunhui Guo)

10:50 - 11:00 Break

11:00 - 11:20 Code tutorial (Max van Spengler)

11:20 - 11:30 Break

11:30 - 12:00 Visual learning with hierarchies (Stella Yu)

12:00 - 12:10 Closing remarks (Pascal Mettes)

Slides and recordings

The slides and the video recordings will be made publicly available after the tutorial.

Organizers

Materials of previous tutorial

Recordings of ECCV 2022 tutorial: https://www.youtube.com/playlist?list=PLkzbr3Qv3gPpYCL4J6I3YP_FT5buH2V5P

Website and code examples of ECCV 2022 tutorial: https://sites.google.com/view/hyperbolic-tutorial-eccv22