First day of instruction: Aug 27th, Thursday
Last day of instruction: Dec 3, Thursday
Lecture 1 -- Aug 27th -- Intro to information Theory, Historical background
Lecture 2 -- Sept 1st -- Intro to Entropy, Relative Entropy
Lecture 3 -- Sept 3rd -- Mutual Information, Chain rule
Lecture 4 -- Sept 8th -- Properties of relative entropy/mutual information, data processing
Lecture 5 -- Sept 10th -- AEP, Data compression
Lecture 6 -- Sept 15th -- Source Coding, prefix-free codes, Kraft's inequality
Lecture 7 -- Sept 17th --Optimal Codes, Huffman codes, Uniquely decodable codes
Lecture 8 -- Sept 22nd -- Unique decodable codes contd. Practical schemes; Arithmetic codes introduction
Lecture 9 -- Sept 24th -- Arithmetic code -- encoding and decoding
Lecture 10 -- Sept 29th -- Communication over noisy channel--channel capacity
Lecture 11 -- Oct 1st -- Channel coding theorem; examples of channels
Lecture 12 -- Oct 6th -- Achievability via random coding for BEC
Lecture 13 -- Oct 8th -- Achievability contd., Joint typical sequences, BSC
Lecture 14 -- Oct 13th -- Fano's inequality, Converse using Fano's inequality
Lecture 15 -- Oct 15th -- Separability theorem, intro to polar codes
Midterm -- Oct 20th (Syllabus: Upto Lecture 13)
Lecture 16 -- Oct 22nd -- Polarization of Channels, polar codes for BEC
Lecture 17 -- Oct 27th -- Polar Codes conclusion, Intro to continuous channels
Short Presentation -- Oct 29th -- Spotlight Presentation by students
Lecture 18 -- Nov 3rd -- Differential Entropy, relative entropy and mutual information
Lecture 19 -- Nov 5th -- Guest Lecture; Swanand Kadhe; LDPC codes and Network information theory
Lecture 20 -- Nov 10th -- Gaussian Channels contd., Water filling
Lecture 21 -- Nov 12th -- Maximum entropy principle, exponential families
Lecture 22 -- Nov 17th -- Hypothesis Testing, Neyman-Pearson, Estimation theory
Lecture 23 -- Nov 19th -- Fisher Information, Cramer-rao lower bound
Lecture 24 -- Nov 24th -- Intro to Generative Adversarial Networks (GANs)
Extra Tentative topics: CT- Chap 11 (Method of Types, Probability of type class, Application in Law of large numbers, large deviation)
Dec 1st -- Student Presentations/Poster
Dec 3rd -- Student Presentations/Poster