The complexity of many biological, social and technological systems stems from the richness of the interactions among their units. Over the past two decades, a great variety of complex systems has been successfully described as networks whose interacting pairs of nodes are connected by links. Yet, from face-to-face human communications to chemical and biological reactions, many interactions in networked systems cannot be described by simple dyads, as they can occur in groups composed by any number of units. Until recently, little attention has been devoted to such high-order architecture of real complex systems. However, a mounting body of evidence is showing that taking the high-order structure of these systems into account can greatly enhance our modelling capacities and help us to understand and predict their emerging dynamical behaviours.
The aim of this satellite is to provide a coherent window on the emerging subfield of networks beyond pairwise interactions. In particular, we will discuss how to represent higher-order interacting systems, and how to unify the diverse frameworks most commonly used to describe higher-order interactions, highlighting the numerous links between the existing concepts and representations. We also focus on recent advances on the structural measures developed to characterize the structure of these systems, on the related generative models, and on novel emergent phenomena characterizing landmark dynamical processes when extended beyond pairwise interactions.
Melanie Weber
Harvard University
A Geometric Lens on Higher-Order Information in Graph Machine Learning: Challenges, Insights, and Remedies
Graph Neural Networks (GNNs) have achieved notable success in learning on graph-structured data in areas such as biochemistry, drug discovery, and materials science. However, GNNs are not without challenges. In this talk we discuss two challenges that arise in when the learning task depends on higher-order information: First, deeper GNNs exhibit instability due to the convergence of node representations, known as oversmoothing, which can reduce their effectiveness in learning long-range interactions and dependencies. We propose and study unitary graph convolutions, which allow for deeper networks that provably avoid oversmoothing during training. Our experimental results confirm that Unitary GNNs achieve competitive performance on benchmark datasets. Second, GNNs have limited expressivity in that there are fundamental function classes that they cannot learn. An effective remedy for limited expressivity is the use of encodings, which augment the input graph with additional structural information. We propose novel encodings based on discrete Ricci curvature, which lead to significant gains in empirical performance and expressivity by capturing higher-order relational information. We then consider the more general question of how higher-order information can be leveraged most effectively in graph learning. We propose a set of encodings that are computed on a hypergraph parametrization of the input graph and provide theoretical and empirical evidence for their effectiveness.
Alison Goodwell
University of Illinois
Characterizing process connectivity, drivers, and predictability in Earth’s critical zone
In highly productive agricultural landscapes, human impacts combine with naturally variable climate and geology to fundamentally alter processes in the critical zone (CZ), the layer of the Earth’s surface that includes root-soil-vegetation-atmosphere interfaces. For example, artificial drainage and fertilizer applications impact riverine transport of water and nutrients, and abrupt transitions in vegetation states impact land-atmosphere fluxes of water and energy. Subsystem components may switch from being nearly independent to tightly synchronized, and drivers may elicit non-linear or threshold responses. These shifts have implications for predictive understanding in Earth and environmental science, but are challenging to identify and quantify. This presentation will explore information theory and other data-driven methods to identify process connectivity, predictability, and temporal regimes in CZ behaviors, based on multivariate high frequency datasets, spatially gridded data, and ecohydrological model results. In a modeling context, these metrics can be considered as measures of “functional performance”, or the extent to which our models “get the right answers for the right reasons”.
Hanlin Sun
NORDITA
The dynamic nature of percolation on networks with triadic interactions
Percolation establishes the connectivity of complex networks and is one of the most fundamental critical phenomena for studying complex systems. On simple networks, percolation displays a second-order phase transition; on multiplex networks, the percolation transition can become discontinuous. However, little is known about percolation in networks with higher-order interactions. Here, I will show that percolation can be turned into a fully fledged dynamical process when higher-order interactions are taken into account. By introducing signed triadic interactions, where a node can regulate the interactions between two other nodes, we define triadic percolation. We uncover that in this paradigmatic model the connectivity of the network changes in time, and the order parameter undergoes period doubling and a route to chaos.
I will present a general theory for triadic percolation that accurately predicts the full phase diagram on random graphs, confirmed by extensive numerical simulations, and show that real network topologies reveal similar phenomenology. I will then discuss recent extensions showing that triadic interactions can induce dynamical topological patterns in spatial higher-order networks, generate rich spatio-temporal activity regimes in an in silico neural medium, and produce even richer bifurcation diagrams in multilayer networks. These results radically change our understanding of percolation and may be used to study complex systems where functional connectivity changes dynamically and non-trivially, such as neural, climate and ecological systems.
Laurent Hébert-Dufresne
University of Vermont
Simplicial stars:
Alice Patania
University of Vermont
Structure & Dynamics
The study of higher-order networks has flourished in recent years to explore how different multibody interactions can affect the structure and dynamics of complex systems. Yet, most higher-order descriptions remain rooted on the concept of nodes, representing graphs through the hyperdegree distributions of nodes, or the sizes and overlaps of hyperedges in terms of numbers of nodes. We introduce k-star covers as a novel structural decomposition for higher-order networks. A k-star cover is defined as a set of structures of order k overlapping on shared structures of order k-1, generalizing the notion of star graphs to higher orders: 1-stars correspond to regular star graphs, 2-stars to triangles overlapping on edges, and so on. We show that k-star covers provide a principled and computationally tractable framework for characterizing multi-body correlations in hypergraphs at multiple scales. We compute k-star covers for real-world hypergraph datasets as well as clique complexes of regular graphs, demonstrating that this decomposition captures structural information beyond standard pairwise adjacency representations. Our results suggest that k-star covers offer a promising building block for the development of more expressive models of structure and dynamics on higher-order networks.
All meeting participants need to be registered for the main conference here.
09:00-09:05: Opening remarks
09:05-10:30: Session I - Topology, Geometry, and Structure
09:05: Melanie Weber, A Geometric Lens on Higher-Order Information in Graph Machine Learning: Challenges, Insights, and Remedies
09:50: Sarah Tymochko, TBA
10:10: Phil Chodrow, Models and Algorithms for Edge-Dependent Hypergraphs
10:30-11:00: Coffee break
11:00-12:30: Session II - Information Theory
11:00: Allison Goodwell, Characterizing process connectivity, drivers, and predictability in Earth’s critical zone
11:45: Thomas Varley, What does higher-order information actually tell us about the brain?
12:05: Helcio Felippe, Structural reducibility of hypergraphs
12:30-14:30: Lunch
14:30-16:00: Session III - Dynamics
14:30: Hanlin Sun, The dynamic nature of percolation on networks with triadic interactions
15:15: Laurent Hébert-Dufresne & Alice Patania, Simplicial stars: Structure & Dynamics
16:00-16:30: Coffee break
16:30-18:00: Social hour
Northeastern University
Princeton University
University of Namur
Central European University
Polytechnic of Turin
Central European University
Northeastern University London
Northeastern University London
Polytechnic University of Turin
University of Vermont
Alice Patania
University of Vermont