MARTINGALE APPROXIMATION AND SCALING LIMITS FOR ADDITIVE FUNCTIONALS OF MARKOV PROCESSES

A TCC COURSE HELD FOR GRADUATE STUDENTS OF MATHEMATICS AT BATH, BRISTOL, IMPERIAL COLLEGE LONDON, OXFORD AND WARWICK

2020 AUTUMN (OXFORD: MICHAELMAS) TERM

LECTURER: BÁLINT TÓTH (BRISTOL AND BUDAPEST)


MESSAGES FOR STUDENTS ATTENDING THE COURSE:

19 November 2020:

**** PhD STUDENTS: LET ME ALSO KNOW WHETHER YOU TAKE THIS COURSE FOR CREDIT OR AUDITING ONLY. EMAIL: balint.toth@bristol.ac.uk. INFO ABOUT ASSESSMENT FURTHER DOWN THIS PAGE. ****

----------------------------------------

|||| DOWNLOADABLE LECTURE NOTES/SLIDES FURTHER DOWN ON THIS PAGE ||||

----------------------------------------

\\\\ THIS PAGE IS UPDATED REGULARLY \\\\

GENERAL OVERVIEW:

The Central Limit Theorem for sums of independent random variables has a long history starting in the early 18th century and completed by the mid-20th – with contributions from some of the best mathematicians of two hundred+ years. In the applied context (among abundantly many other applications) it serves to modelling diffusion in its many disguises. However, from a physical point of view, assuming independence of the increments is unrealistic and prohibitively restrictive. The problem of understanding diffusive behaviour of processes with stationary but far from independent increments is mathematically deep and difficult beside being overly well justified by physical (and many other) applications.

This lecture course will focus on mathematically rigorously understanding the diffusive (and occasionally anomalous, super-diffusive) behaviour of such processes arising in a very natural context, like sums/integrals along the trajectory of a Markov chain/process, of some naturally chosen function of its state. Motivations come from random walk/diffusion in random environment, tagged particle (self-) diffusion in interacting particle systems, self-interacting random walk/diffusion, some problems raised in MCMC, etc. In all cases the long memory is essential and non-classical ideas and methods are unavoidable. The basic approach is a martingale approximation initiated in the celebrated paper of C Kipnis and SRS Varadhan (1986) and further refined and developed during the last decades. Hence the shorter title of this lecture course could be Introduction to Kipnis-Varadhan Theory.

Prerequisites: It is assumed that the attending student has solid knowledge of Markov chains/processes and functional analysis on Hilbert spaces, including spectral calculus.

DETAILS:

The following topics are intended to be covered during the course. The main theorems will be presented in full detail. Due to time constraints some of the applications will probably be somewhat sketchy.


  1. Motivating examples (and counterexamples):

  • The baby example: CLT for additive functionals of finite irreducible Markov chains

  • Observing a random scenery along a random walk trajectory. Does the CLT hold?

  • Random walk in random environment (random conductances, divergence-free random drift field). Does the CLT hold?

  • Tagged particle diffusion in interacting particles systems.

  • MCMC

  1. Preliminaries:

  • Analytic approach to stationary Markov chains/processes: L^2 framework, Markov semigroups and their infinitesimal generators.

  • Dynkin martingales.

  • The Martingale CLT.

  • The theorem of Gordin and Lifshitz.

  • Examples revisited.

  1. Martingale approximation of additive functionals, Kipnis-Varadhan theory:

  • Reversible setting: Kipnis-Varadhan theorem.

  • Extension to non-reversible setting, full proof.

  • Maxwell-Woodroofe theorem and its reduction to KV.

  1. First applications:

Application: Tagged particle diffusion in symmetric simple exclusion process [SSEP].

Application: Random walk among random conductances.

Application: Persistent random walk in random environment - a caricature of the Lorentz gas.

  1. Sector conditions

  • The Strong Sector Condition.

Application: Tagged particle diffusion in zero mean asymmetric simple exclusion process [ASEP]

Application: Random walk in random divergence-free drift of finite cycle type.

  • The Graded Sector Condition

Application: Tagged particle diffusion in asymmetric simple exclusion process [ASEP] in $d \geq 3$.

Application: Diffusion in divergence-free Gaussian drift field.

6. Random walk in divergence-free random drift

  • Relaxation of the sector conditions.

Application: Random walk in div-free drift: $H_{-1}$ suffices.

7. Further applications and outlook.

WHEN?

LECTURE HELD ON WEDNESDAYS 10:00-12:00 (UK TIME)

FIRST LECTURE: WEDNESDAY, 14 OCTOBER 2020

LAST LECTURE: WEDNESDAY, 2 DECEMBER 2020

WHERE?

THE LECTURES WILL BE HELD ON MICROSOFT TEAMS PLATFORM WITH ACCESS PROVIDED TO REGISTERED ATTENDANTS.

LECTURE NOTES AND/OR SLIDES:

  1. Motivating examples (last modified: 14 Oct 2020)


  1. Preliminaries (last modified: 20 Oct 2020)

2-suppl-A: Semigroups, generators, resolvents, Hille-Yosida thm (last modified: 5 Oct 2020)

2-suppl-B: Martingale CLT (coming soon) [till then here is a link to DL McLeish (1974)]




  1. Sector conditions (last modified: 17 Nov 2020)




ASSESSMENT FOR CREDIT:

Those PhD students who take this course for credit will be assessed in the following way: I will provide some extra material for reading. This will be either a research paper or some theoretical part not fully covered in class. The student will be asked to read and understand the material and to write an essay of cca 15 pages about it, in style and format of a research paper.

Timing: The reading material will be provided towards the end of the TCC term (by end of Nov). Deadline for handing in the essay sometime in the winter break (mid-or end of January).

Please let me know whether you take this course for credit or audit only.

BIBLIOGRAPHY:

RESEARCH PAPERS:

Here follows an annotated list of some of the original research papers where the basic ideas of Kipnis-Varadhan theory had been developed. The lecture course is mainly based on the content of these papers. The list reflects the developments in chronological order. The list will be extended.

This is a short and technically simple but very innovative paper. Assuming that the observed function is in the range of the infinitesimal generator, the Dynkin-martingale is directly at hand. This is the entry point to the theory.

This is the celebrated Kipnis-Varadhan paper. A complete (if-and-only-if) characterization of the efficient martingale approximation is provided in the reversible case (with self-adjoint infinitesimal generator). Applications to tagged particle diffusion in symmetric simple exclusion process and to random walk among random conductances are the motivating applications.

In this paper the Kipnis-Varadhan approach is extended to the non-reversible (non-self-adjoint) setting, replacing spectral calculus with resolvent calculus. The extension is primarily motivated by application to a random walk in random environment problem.

This paper provides a survey of Kipnis-Varadhan theory in the reversible setting with many relevant applications.

The strong sector condition is introduced for handling some non-reversible settings. Applied to tagged particle diffusion in non-symmetric but zero mean simple exclusion.

In this paper the so-called graded sector condition is introduced in order to handle some more complex non-reversible cases where the strong sector condition does not hold. The method is applied to tagged particle diffusion in non-symmetric simple exclusion with possibly non-zero mean, in dimension 3 or more.

  • M Maxwell, M Woodroofe: Central limit theorems for additive functionals of Markov chains. Ann. Probab. 28 (2000).713–724 click here for open access

This paper provides an alternative approach to control the martingale approximation in general (non-reversible) setting. It is mainly motivated by MCMC.

In this paper the Graded Sector Condition method is applied to diffusion in a divergence-free Gaussian random drift field. CLT is obtained under the $H_{-1}$-condition

A weaker (than the graded) sector condition is formulated and proved to be sufficient to control the martingale approximation. It is shown that this is indeed weaker than the gsc.

It is shown that the theorem of Maxwell-Woodroofe (see above) is a direct consequence of the non-reversible extension (as in Toth (1986)) of Kipnis-Varadhan.

Diffusive CLT is established for random walks in divergence-free random drift field. This is an application of the relaxed sector condition.

BOOKS, MONOGRAPHS:

  • TEXTBOOK ABOUT CONTINUOUS TIME MARKOV CHAINS AND PROCESSES

TM Liggett: Continuous Time Markov Processes - An Introduction. Graduate Studies in Mathematics, 113. American Mathematical Society, Providence, RI, 2010. click here for MathSciNet review of the book

  • TEXTBOOK ON FUNCTIONAL ANALYSIS

M Reed, B Simon: Methods of Modern Mathematical Physics. vol. 1. Functional Analysis, vol. 2. Self-Adjointness. Academic Press New York, 1972-1975.. click here for MathSciNet review of the books

  • MONOGRAPH ABOUT THE SUBJECT OF THIS COURSE

T Komorowski, C Landim, S Olla: Fluctuations in Markov Processes. Time Symmetry and Martingale Approximation. Grundlehren der Mathematischen Wissenschaften vol. 345. Springer, Heidelberg, 2012. click here for MathSciNet review of the book

Huge technical monograph, covering the state of the art at the time of publication.