Mondays 4:30 PM - 6:00 PM
Thursdays 2:00 PM - 3:30 PM
Homogeneous Poisson process on the positive real numbers.
Discrete Markov chains with countable state space. Classification of states - recurrence, transience, periodicity. Stationary distributions, reversible chains. Several illustrations.
Continuous time Markov chain with countable state space (if time permits).
S. M. Ross: Stochastic Processes
S. I. Resnick: Adventures in Stochastic Processes
Lectures will be held on the Zoom platform. Lecture video and slides will be uploaded here.
Problems will be given regularly in the lectures. The students will not have to submit the solutions. However, they are encouraged to solve them all, discuss the solutions with each other and also ask the teacher if there is any doubt. Problems similar to these will be given in the exams.
Evaluation will be carried out based on a mid-semester examination and a final examination with 50% weightage on each. The mode of these exams will be announced later.