TIMETABLE:
Wednesday 16.00 -19.00 - Aula Careri
Thursday 16.00-19.00- Aula Careri
Lectures:
01/10/2025 (3 h)
Introduction to complex systems.
Accompanying slides on the Prolusion [PDF]
02/10/2025 (3 h)
(1) Introduction to probability density functions (pdf). Observables and non-normalizable distributions. Distribution of a dependent variable and relation with the generation of random numbers. The sum of two random variables. Characteristic functions and Convolution theorem. Cumulants for the sum and the average of i.i.d random variables. (2) Moments for the sum and the average of i.i.d. random variables. Derivation of the Central Limit Theorem for distributions with well-defined moments. (3) Introduction to power-laws: normalisation and representations. Generation of random variables with a generic probability distribution: the case of power-laws. Criterion of Maximum Likelihood. Application to the estimation of the exponent of a power-law.
08/10/2025 (3 h)
(1) Frequency-rank plot and its relation with the pdf. Again, on the criterion of Maximum Likelihood. Estimation of the exponent of a power-law and the error on the estimate. Estimate of the maximum value of a sample drawn from a power-law pdf. (2) Probability distribution functions for extreme events drawn from a power-law distribution. Fréchet distribution. Cauchy-Lorentz distribution. Calculation of the first and second moments. Computation of the characteristic function and proof that a sum of Cauchy-distributed random variables is again Cauchy-distributed. (3) Lévy's distribution: calculation of the moments. Stable distributions and alpha-stable distributions. Conditions on the exponents of a power-law pdf for the existence of the moments.
09/10/2025 (3 h)
(1) Central Limit Theorem for long-tailed distributions with well-defined variance. Central Limit Theorem for long-tailed distributions without a well-defined variance: the case of the Cauchy distribution as an alpha-stable distribution. (2) Benford's law. Empirical observations, scaling arguments and explanation based on multiplicative processes. More on multiplicative processes and log-normal distributions. Zipf's law: empirical observations, normalisation depending on the value of the exponent. (3) Relationship between the Zipf's exponent and the exponent of the usual probability distribution function. Heaps' law: empirical observations. Taylor's law. Example of its derivation for a Poissonian process.
15/10/2025 (3 h)
(1) First notions on scaling: Galileo (1638) and examples from biology and cities. Scale-invariance and power-laws. Mechanisms leading to the emergence of power-laws: combination of exponentials: Monkey typing, (2) inverse quantities. Yule-Simon process: calculation of the probability distribution of frequencies and (3) the frequency rank distribution.
16/10/2025 (3 h)
Again on the Yule-Simon model. Solution with the quenched version of the model: at each time step, m species are reinforced, and one brand-new species is introduced. First-return times in a one-dimensional Random Walk. Introduction to critical phenomena. Example of percolation: Phenomenology and Real Space Renormalisation group in 1-D and for a 2-D triangular lattice. Self-Organised Criticality (SOC). Introduction to the overall phenomenology. Criticality vs. Self-Organised Criticality: The role of time-scale separations in SOC is to be tuned at the critical point. Sandpile model.
Accompanying slides about Power-laws and Scale Invariance [POWER_LAWS.pdf]
22/10/2025 (3 h)
(1) Self-Organised Criticality (SOC). Introduction to the overall phenomenology. Sandpile model. Definition of the main quantities. Real Space Renormalisation Group for the Sandpile model and computation of the critical exponents. (2) Introduction to network science. Phenomenology in several domains: technological networks, information networks, and social networks. (3) Basic notions of graph theory: undirected and directed networks, unweighted and weighted networks, single and multiple edges, self-edges, cycles, Directed Acyclic Graphs (DAG). Adjacency matrix. Bipartite networks and Incidence matrix. Projections of bipartite networks. Trees. Degree, in-degree, out-degree, mean degree, density.
23/10/2025 (3 h)
(1) Walks, paths and loops and their computation in terms of the adjacency matrix. Laplacian matrix and its properties. (2) Eigenvalues and eigenvectors. Random walks on networks. Centrality measures: degree, eigenvector centrality, (3) Katz centrality. PageRank centrality. Betweenness centrality.
29/10/2025 (3 h)
(1) Transitivity and clustering coefficient. Assortativity. Random graphs G(n,m) and G(n,p). (2) G(n,p) and its properties: diameter, size of the giant component. Configuration model. Knn assortativity and its interpretation in the configuration model. (3) Friendship paradox and excess degree distribution. Models of network formation. Preferential attachment. Barabasi-Albert model: definition.
30/10/2025 (3 h)
(1) Barabasi-Albert model: definition and calculation of the degree distribution via two different methods: Differential equation for the evolution of the degree. Master equations for the in-degree and the total degree distribution. (2) First notions of epidemic spreading. SI and SIR models under the homogeneous mixing hypothesis. Graphical solutions and identification of the epidemic threshold. Basic reproduction number and its link with the epidemic threshold. (3) Epidemics on networks. Transmission probability and mapping the epidemic threshold to the bond percolation. The SIR model on networks. Calculation of the epidemic threshold for random graphs and power-law degree distributions. Considerations on the zero value that the epidemic threshold can acquire for specific networks. Size of the giant component.
Accompanying slides about Networks [PDF]
05/11/2025 (3 h)
Discussion on the general problem of defining a measure for the information content of a “source” of messages or a stochastic process. Definition of the Shannon entropy for a discrete probability distribution. Case of equiprobable states and the general case. Discussion of the Shannon entropy of a Bernoulli distribution. Shannon construction and derivation from the central limit theorem. Equivalence of the Shannon entropy and the thermodynamic entropy in the case of the microcanonical and canonical ensembles. Maximum entropy principle. Derivation of the probability distribution of states in the microcanonical and canonical ensembles from the maximum entropy principle.
Asymptotic equipartition property (AEP). The typical set.
06/11/2025 (3 h)
Discussion on the general problem of encoding. Consequences of AEP on the minimal average length of the encoding of messages from sources producing sequences of i.i.d. random variables. Joint and conditional entropy. Block entropies, differential entropies, and Shannon entropy per character (or entropy rate) of stationary stochastic processes. Shannon-McMillan-Breiman theorem (without demonstration) and its consequences for sequences generated by stationary stochastic processes. Cross-entropy and relative entropy or Kullback-Leibler divergence. Jensen inequality for discrete probability distributions. Positivity of the relative entropy.