Course Instructor:
Dr. Matadeen Bansal
Email: mbansal@iiitdmj.ac.in
Session: Semester-II, AY 2024-25
Webpage: https://sites.google.com/view/mbansal
Course Content:
Review of probability theory, Entropy: marginal entropy, joint entropy, conditional entropy, and the chain rule for entropy. Mutual information between ensembles of random variables.
Source Coding theorems: prefix, variable, and fixed-length codes. Channel models and channel capacity. Channel Coding theorem.
Linear Block Codes: Generator and parity check matrices, Minimum Distance, Syndrome decoding, Bounds on minimum distance.
Cyclic Codes: Finite Fields, binary BCH codes, RS Codes.
Convolutional Codes: Encoders, Trellis, Viterbi decoding.
Course Timings:
Tuesday 10:00-11:00 (CR102)Wednesday 16:00-11:00 (CR102)Friday 14:00-15:00 (CR102)Previous Years' Lecture Notes:
20_01_27-01_28-01_ITC1
31-01-22_ITC2
01_02_22 to 10_02_22_ITC3
Evaluation and Other Requirements:
Prerequisites
-Random Variables and Stochastic Processes
-Linear Algebra, Matrices etc.
-Comfort with Mathematics.
Four Evaluations (Quiz-1 (10%), Quiz-2 (10%), Mid-Term (30%), and End-Term (50%))
Recommended Books:
Thomas M. Grover and Joy A. Thomas, “Elements of Information Theory,” Wiley.
Shu Lin and Daniel J. Costello, Jr., Error Control Coding: Fundamentals and Applications, 2nd Ed., Prentice-Hall, 2004.
B. Sklar, Digital Communications: Fundamentals and Applications, 2nd Ed., Prentice-Hall, 2001.
John G. Proakis and Masoud Salehi, Digital Communications, 5e, McGraw-Hill Education, 2007.