This lecture series was given in the Spring Term, 2011 at the Wellcome Trust Centre for Human Neuroimaging at UCL. The idea was to juxtapose two perspectives on human brain function:
Bayesian Inference: Lectures 1 to 5 (and 11)
Dynamical Systems: Lectures 6 to 10
All lecture notes in a single document with extra material on control theory and mathematical appendices (PDF).
- Bayes rule for Gaussians. Directed Acyclic Graphs
- Joint Densities and Marginalisation. Medical Decision Making.
- Perception as statistical inference. Decision Making Dynamics.
- Bayesian Sensory Integration. Explaining Away.
PDF
- Linear Models. Maximum Likelihood. fMRI analysis.
- Delta rule learning. Newton method.
- Weighted Least Squares. Marginal Likelihood.
- MEG source reconstruction. Empirical Bayes.
- Restricted Maximum Likelihood (ReML)
PDF
- Relevance Vector Regression. Automatic Relevance Determination.
- Recurrent Lateral Inhibition. Linear predictive coding. Hebbian Learning.
- Sparse coding of natural visual images. MAP learning. Cauchy priors.
PDF
- Linear Hierarchical Models. Superficial versus Deep Cortical Laminae.
- Hierarchical predictive coding. Increasing receptive field size. Simple cells.
- End Stopping. Nonlinear hierarchical models
PDF
- Information, Entropy,Source Coding Theorem, Prefix Coding,
- Kullback-Liebler Divergence, Asymmetry,
- Multimodality,Variational Free Energy, Factorised Approximations,
- Mean Field Approach, Free-Form versus Fixed Form,
- Nonlinear Regression, Adaptive Step Size, Approach to Limit.
PDF
- Linear differential equations. Matrix Exponential. Eigendecompostion.
- Nodes, Saddles, Spirals, Centres. Feeback Inhibition. Stability.
- Local linear stability analysis. Isoclines. Nonlinear Oscillations.
- Spiking Neurons. Fitzhugh-Nagumo. Hodgkin-Huxley. Rose Hindmarsh.
- Hopf and Saddle-Node Bifurcations. Type 1/2 Cells.
PDF
- Integrate and Fire Neurons.Phase Reduction.
- Phase Response Curves. Weakly Coupled Oscillators.
- Synchronization via excitation or inhibition.
- Spike Frequency Adaptation (SFA).
- Spike Time Dependent Plasticity (STDP).
- Dynamic pattern recognition via transient synchronisation.
- Spike-to-Spike versus LFP synchronization.
PDF
- Neural Mass Model. Alpha activity. Spike cycles. Bifurcations.
- Hierarchical cortical connectivity. Delay differential equations.
- Dynamic Causal Models (DCM) for Event Related Potentials.
- Auditory oddball. Linear Systems Analysis.
- Network kernel function. Frequency response. Cross Spectral Density.
- DCM for steady state responses. Inferring synaptic physiology.
PDF
- Wiener, Ornstein-Uhlenbeck (OU) and Gaussian processes.
- Stochastic Differential Equations. Stochastic chain rule.
- Mean and variance functions.
- Rodriguez-Tuckwell method for multivariate Gaussian
- Approximation of population density evolution.
- Population of Fitzhugh-Nagumo neurons.
- Fokker Planck Equation. Population of stochastic integrate and fire cells.
- 2AFC tasks. Drift Diffusion Models.
- Reaction Times and Error Rates.
- Continuum limit of discrete time Bayesian model.
PDF
10. Hierarchical Dynamic Models
- OU(p) processes. Covariance functions. MEG alpha rhythms.
- Embedding and Generalised Coordinates.
- Continuous time latent variable models.
- Filtering. Variational Energies and Actions.
- Dynamic Expectation Maximisation. Linear Convolution Model.
- Hierarchical Dynamic Models.
PDF
11. Bayesian Model Comparison
- Posterior model probability, Bayes factors, Odds Ratios
- Model evidence. Free Energy. Approximation.
- Accuracy and Complexity Decompositions.
- AIC and BIC. Linear Models. fMRI example simulations.
- DCM for fMRI example. Priors. Simulations.
- Inference for groups of subjects. Fixed Effects.
- Random effects generative model. Gibbs sampling.
- Exceedance probabilities.
PDF
Useful Resources: