Hypergraph Neural Networks:
An In-Depth and Step-By-Step Guide
Sunday, August 25
from 2:00 PM to 5:00 PM

KAIST
Seoul, South Korea

University of Turin
Turin, Italy

KAIST
Seoul, South Korea

University of Turin
Turin, Italy

Tsinghua University
Beijing, China

KAIST
Seoul, South Korea

Check out a recent survey on hypergraph neural networks (https://arxiv.org/pdf/2404.01039)

Summary

Investigating deep learning for higher-order interactions (HOIs), which are prevalent in real-world complex systems and applications, is gaining increasing attention in data mining and machine learning fields. Hypergraph neural networks (HNNs), a class of neural networks designed to operate on hypergraphs, have recently become a significant method for learning representations in networks of HOIs. Given the emerging trend, we provide a first and timely tutorial dedicated to HNNs. In this tutorial, we provide an in-depth and step-by-step guide on HNNs. Specifically, we cover the following topics in detail: (1) three key components of HNNs, (2) training strategies for HNNs, (3) applications of HNNs (e.g., recommender systems and time series analysis), and (4) open problems on HNNs. 

Target audience: This tutorial is intended for researchers and practitioners who are interested in representation learning for HOIs and its significant applications, especially recommender systems. 

Prerequisites: Specialized engineering skills are not required, but a preliminary understanding of graph representation learning would be beneficial.

Schedule

Sunday, August 25 from 2:00 PM to 5:00 PM

Slides

Part 1. Introduction
[ DOWNLOAD | DROPBOX ]

Part 2. Input Features and Structures
[ DOWNLOAD | DROPBOX ]

Part 3. Message Passing
[ DOWNLOAD | DROPBOX ]

Part 4. Training Strategies
[ DOWNLOAD | DROPBOX ]

Part 5. Applications
[ DOWNLOAD | DROPBOX ]

Part 6. Conclusions
[ DOWNLOAD | DROPBOX ]

Presenters

Soo Yong Lee is a Ph.D. student at Kim Jaechul Graduate School of AI, KAIST, South Korea. He received his M.S. degree in artificial intelligence from KAIST in 2023 and B.S. degree in psychology from UCSD in 2016. His research interests include (hyper)graph representation learning and mining. His works have been published in major venues, including WWW, CIKM, ICML, and ICLR.

More information about Soo Yong can be found at https://github.com/syleeheal/.

Sunwoo Kim is a Ph.D. student at Kim Jaechul Graduate School of AI, KAIST, South Korea.} He received his M.S. degree in artificial intelligence from KAIST in 2024 and B.A. degree in applied statistics from Yonsei University in 2022. His research interests include hypergraph representation learning and mining. His works have been published in major venues, including KDD, ICDM, ICLR, and CVPR.

More information about Sunwoo can be found at https://sites.google.com/view/sunwoo97.

Yue Gao is a Tenured Associate Professor at the School of Software, Tsinghua University, China. He received his Ph.D. from the Department of Automation at Tsinghua University in 2012. His research falls in the fields of AI, CV, and brain science. He has published 100+ papers in premier conferences and journals, including KDD, CVPR, and TPAMI. He also serves as an editorial board member/associate editor for the International Journal of Computer Vision and Medical Image Analysis. He is a Senior Member of IEEE and a Member of ACM.

More information about Sunwoo can be found at https://www.thss.tsinghua.edu.cn/en/faculty/yuegao.

Alessia Antelmi is an Assistant Professor at the Department of Computer Science of the University of Turin, Italy.} She received her MSc and Ph.D. in Computer Science from the University of Salerno (Italy) in 2018 and 2022, respectively. In 2018, Alessia got a student travel grant to visit the Unit for Social Semantics, Data Science Institue (Galway, Ireland), led by Prof. John Breslin, and, in 2023, a research grant to join the NERDS research group at ITU to work on the COCOONS project led by Prof. Luca Maria Aiello. Her research primarily relates to exploiting hypergraphs to study the high-order relationships characterizing real-world phenomena, specifically focusing on online social influence diffusion and collective behavior.

More information about Alessia can be found at https://alessant.github.io/.

Mirko Polato is an Assistant Professor at the Department of Computer Science of the University of Turin, Italy. Mirko Polato received his Ph.D. in Brain, Mind, and Computer Science from the University of Padova (Italy) in 2018. In 2017, Dr. Polato was a visiting Ph.D. student at the Delft University of Technology in the Multimedia Computing group. From 2018 to 2021, he was a post-doctoral fellow at the University of Padova, working on two H2020 projects. Since 2021, he has been an Assistant Professor at the University of Turin, and his main research topics include federated learning, interpretable machine learning, hypergraph representation learning, and recommender systems. He co-organized Special Sessions and Workshops on many top venues, including WWW and IJCNN. He served as a Program Committee member of several international conferences and as a referee for several international journals. He authored about 50 research products, including international peer-reviewed conferences and journal papers.

More information about Mirko can be found at https://makgyver.github.io.

Kijung Shin is an Associate Professor jointly affiliated in the Kim Jaechul Graduate School of AI and the School of Electrical Engineering at KAIST, South Korea.} He received his Ph.D. in Computer Science from Carnegie Mellon University (USA) in 2019. His research interests span various topics on data mining and machine learning for (hyper)graph-structured data, with a focus on scalable algorithm design and empirical patterns in the real world. He has published more than 80 referred articles in major data mining, database, and machine learning venues. He won the best research paper award at KDD 2016 and the best student paper runner-up award at ICDM 2023. 

More information about Kijung can be found at https://kijungs.github.io.

Important References and Software (TBA)

Datasets and Benchmarks (TBA)