MINDS-MoNET-ISE Workshop




Information, Network & Topological Data Analysis


December 9 (Thursday) ~ December 10 (Friday), 2021

GMT+9, Online streaming


Organizers

Workshop Rationale

Geometry contributes to the critical function of many physical and biological phenomena. However, lesser is known regarding its role in data, information, and neural networks. Recently adopted geometric tools include topological data analysis (TDA) for its shape and information geometry (IG) for its metrics and curvature. This workshop provides lectures on diverse geometric theories and methods to appreciate the distinctive nature of information, networks, and data for its practical applications, particularly to data science and neuroscience.

Registration

Program Overview (GMT+9)

Day 1 (December 9, Thursday)

Morning session

  • 10:00 ~ 11:00 : Dane Taylor

  • 11:00 ~ 12:00 : Hae-Jeong Park

Afternoon session

  • 1:30 ~ 2:30 : Sosuke Ito

  • 2:30 ~ 3:30 : Elizabeth Gross

Day 2 (December 10, Friday)

Morning session

  • 10:00 ~ 11:00 : Michael Lesnick

  • 11:00 ~ 12:00 : Taro Toyoizumi

Afternoon session

  • 1:30 ~ 2:30 : Masafumi Oizumi

  • 2:30 ~ 3:30 : Sehun Chun

Program

Day 1 (December 9, Thursday)

10:00 - 11:00 - Dane Taylor, University at Buffalo, SUNY, Homological analyses of network dynamics

11:00 - 12:00 - Hae-Jeong Park, Yonsei University College of Medicine, Dynamics embedded in the brain network

1:30 - 2:30 - Sosuke Ito, The University of Tokyo, Information geometry, thermodynamics, and biochemical information processing

2:30 - 3:30 - Elizabeth Gross, University of Hawaii Manoa, Learning phylogenetic networks using invariants


Day 2 (December 10, Friday)

10:00 - 11:00 - Michael Lesnick, SUNY Albany, An Introduction to Multiparameter Persistent Homology

11:00 - 12:00 - Taro Toyoizumi, RIKEN Center for Brain Science, On the Achievability of Blind Source Separation for High-Dimensional Nonlinear Source Mixtures.

1:30 - 2:30 - Masafumi Oizumi, The University of Tokyo, Quantifying neural interactions based on information geometry

2:30 - 3:30 - Sehun Chun, Yonsei University, Finding curvature threshold in the ephaptic propagation along for white matter tractography



Invited Speakers

Dane Taylor

(SUNY Buffalo)

Homological analyses of network dynamics


Abstract: Dynamical processes over networks have widespread applications including the study of social activity, brain dynamics, and heat diffusion, the latter two of which also help provide mathematical foundations for algorithms in machine learning and AI. In this talk, I will present my work that approaches this field from the perspective from homology, the mathematical subfield that formally studies ``holes'' in structures. In particular, I will present theory and experiments that use the TDA framework of persistent homology to study wavefront propagation for social contagions [Nat. Comms. 6, 7723 (2015)] and convection cycles for irreversible Markov chains [arXiv:2109.08746 (2021)]. I will also explore how these dynamical phenomena change as one considers "interconnected networks," such as a transportation system with multiple modes of transportation or a social network with different types of social relations.

Hae-Jeong Park

(Yonsei University)

Dynamics embedded in the brain network


Abstract: One of the important questions about the brain is how dynamic functionalities arise from a stable anatomy. This question was recently formulated in terms of network architecture of the whole brain. When we look at the brain as a whole, the organization of brain networks appears to have properties of complex network systems from which diverse functions emerge. The importance of this systems approach is in its ability to explain intact (or less deficient) information exchange (functional) among brain regions even after anatomical malformation or damage has taken place. Network brain science has disclosed dynamics in the functional networks but also revealed configuration of human brains suitable for transitions among multistable brain states. According to the energy landscape analysis, the brain appears to exhibit multiple stable patterns of the brain activity (multistability) and well-organized transitions among those stable patterns. These dynamic properties of the human brain system may be embedded in the brain network, which can be inferred from neuroimaging data. In the current presentation, dynamic properties of brain networks and brain states estimated from neuroimaging data will be presented. Furthermore, the utility of systems approach and computational theory to treat dynamic brain networks will be discussed.

Sosuke Ito

(The University of Tokyo)

Information geometry, thermodynamics, and biochemical information processing


Abstract: The idea of differential geometry in equilibrium thermodynamics (e.g., Ruppeiner geometry) was discussed at the end of the 20th century. Nowadays, differential geometry in equilibrium thermodynamics is regarded as a variant of information geometry. In recent years, the framework of non-equilibrium thermodynamics, called stochastic thermodynamics, has been studied. In this talk, I would like to explain how we have adopted the concept of information geometry in stochastic thermodynamics [1-6]. Because stochastic thermodynamics is applicable to information processing of biochemical process, our theory can explain information processing of biochemical process and its thermodynamic cost via information geometry.


[1] Ito, S. (2018). Stochastic thermodynamic interpretation of information geometry. Physical review letters, 121(3), 030605.

[2] Ito, S., & Dechant, A. (2020). Stochastic time evolution, information geometry, and the Cramér-Rao bound. Physical Review X, 10(2), 021056.

[3] Ito, S., Oizumi, M., & Amari, S. I. (2020). Unified framework for the entropy production and the stochastic interaction based on information geometry. Physical Review Research, 2(3), 033048.

[4] Yoshimura, K., & Ito, S. (2021). Information geometric inequalities of chemical thermodynamics. Physical Review Research, 3(1), 013175.

[5] Ashida, K., Aoki, K., & Ito, S. (2021). Experimental evaluation of thermodynamic speed limit in living cells via information geometry. bioRxiv, 2020-11.

[6] Ito, S. (2021). Information geometry, trade-off relations, and generalized Glansdorff-Prigogine criterion for stability. arXiv preprint arXiv:1908.09446v3.


Elizabeth Gross

(University of Hawaii)

Learning phylogenetic networks using invariants


Abstract: Phylogenetic networks provide a means of describing the evolutionary history of sets of species believed to have undergone hybridization or gene flow during the course of their evolution. The mutation process for a set of such species can be modeled as a Markov process on a phylogenetic network. Previous work has shown that a site-pattern probability distributions from a Jukes-Cantor phylogenetic network model must satisfy certain algebraic invariants. As a corollary, aspects of the phylogenetic network are theoretically identifiable from site-pattern frequencies. In practice, because of the probabilistic nature of sequence evolution, the phylogenetic network invariants will rarely be satisfied, even for data generated under the model. Thus, using network invariants for inferring phylogenetic networks requires some means of interpreting the residuals, or deviations from zero, when observed site-pattern frequencies are substituted into the invariants. In this work, we propose a machine learning algorithm utilizing invariants to infer small, level-one phylogenetic networks. Given a data set, the algorithm is trained on model data to learn the patterns of residuals corresponding to different network structures to classify the network that produced the data. This is joint work with Travis Barton, Colby Long, and Joseph Rusinko.

Michael Lesnick

(SUNY Albany)

An Introduction to Multiparameter Persistent Homology


Abstract: In topological data analysis (TDA), one often studies the shape of data by constructing a filtered topological space, whose structure is then examined using persistent homology. However, a single filtered space often does not adequately capture the structure of interest in the data, and one is led to consider multiparameter persistent homology, which associates to the data a space equipped with two or more filtrations. This has become one of the most active areas of research within TDA, with exciting progress on several fronts. My talk will introduce multiparameter persistent homology and survey some of this recent progress.


The talk will cover some of the same territory as a forthcoming expository article with the same title, jointly written with Magnus Botnan.


Taro Toyoizumi

(RIKEN)


On the Achievability of Blind Source Separation for High-Dimensional Nonlinear Source Mixtures


Abstract: A combination of principal component analysis (PCA) and independent component analysis (ICA) has been frequently used for blind source separation (BSS). We have previously developed a biologically plausible unsupervised learning algorithm that performs PCA and ICA in a single-layer feedforward neural network with local information available at synapses. However, it remains unclear why these linear methods work well with real-world data that involve nonlinear source mixtures. We theoretically validate that a cascade of linear PCA and ICA can solve a nonlinear BSS problem accurately—when the sensory inputs are generated from hidden sources via nonlinear mappings with sufficient dimensionality. Applying linear PCA to the inputs can reliably extract a subspace spanned by the linear projections from every hidden source as the major components—and thus projecting the inputs onto their major eigenspace can effectively recover a linear transformation of the hidden sources. Then the subsequent application of linear ICA can separate all the true independent hidden sources accurately. Zero-element-wise-error nonlinear BSS is asymptotically attained when the source dimensionality is large and the input dimensionality is sufficiently larger than the source dimensionality. Our results highlight the utility of linear PCA and ICA for accurately and reliably recovering nonlinearly mixed sources and suggest the importance of employing sensors with sufficient dimensionality to identify true hidden sources of real-world data.

Masafumi Oizumi

(The University of Tokyo)


Quantifying neural interactions based on information geometry


Abstract: Assessment of interactions between neurons is an important subject to understand the nature of information processing in the brain. We have previously proposed a unified framework for quantifying neural interactions based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence between the actual probability distribution of a system and a constrained probability distribution where the interactions of interest are disconnected. The degree of interactions quantified in this way can be interpreted as the amount of information loss associated with certain disconnections. Based on the framework, I will cover two topics in this talk; higher-order interactions and integrated information (causal interactions in other words). I will explain how to utilize information geometry for assessing neural interactions and then, introduce some applications to neural data.

Sehun Chun

(Yonsei University)


Finding curvature threshold in the ephaptic propagation for white matter tractography


Abstract: If neural fiber were fully wrapped with myeline, the neural network would be random and arbitrary. The shape of the neural fiber bundle does not matter because the propagation along a fiber does not affect the propagation in the neighborhood fibers. However, the Ranvier nodes of 1/1000 scale to the length of myelin, which compensates the energy loss by myeline leakage, place critical geometric constraints or facilitators on its propagation. Though it is not completely multidimensional propagation as happened in the heart, the neural spike propagation retains some properties in the ephaptic propagation in the neural fiber bundle. In this talk, we explain the motivation, inferred principle, and numerical schemes of neural spike propagation. Also, direct application to white matter tractography is explained from the pros and cons of state-of-the-art tractography.


Contact: jung153@postech.ac.kr