Syllabus:

Module I:                                                                                                                           (8)

Source Coding: Introduction to Information Theory, Uncertainty and Information, Average Mutual Information and Entropy, Information Measure for Continuous Random Variables, Source coding theorem, Huffman Coding, Shannon- Fano -Elias Coding, Arithmetic Coding, The Lempel-Ziv Algorithm, Run Length Encoding, and the PCX Format, Rate Distribution Function, Entropy Rate of a Stochastic Process.             

Module II:                                                                                                                          (12)

Channel Capacity and Coding: Introduction to channel coding, Channel Capacity for MIMO System.         

Linear Block Codes for Error Correction: Introduction to Error Correction Codes, Basic Definitions, Matrix Description of Linear Block Codes, Equivalent Codes, Parity Check Matrix, Decoding of Linear Block Code, Syndrome Decoding, Error Probability after Coding (Probability of Error Correction), Low Density Parity Check (LDPC) Codes, Optimal Linear Codes, Maximum Distance Separable (MDS) code.

Module III:                                                                                                                        (10)

Cyclic Codes: Introduction to the Cyclic Codes, Polynomials, The Division Algorithm for Polynomials, A Method for Generating Cyclic Codes, Matrix Description of Cyclic Codes, Burst Error Correction, Fire Codes, Golay Codes, Cyclic Redundancy Check(CRC) Codes.

Bose Chaudhuri Hocquenghem (BCH) Codes:  Primitive Elements, Minimal Polynomials, Generator Polynomials in Terms of Minimal Polynomials, Some Examples of BCH Codes, Reed–Solomon Codes.

MATLAB implementation of some source coding and error correcting coding schemes.

Books recommended:

TEXT BOOKS

1.  R. Bose, “Information theory Coding and Cryptography,” 2nd Edition, McGraw-Hill, 2008.

REFERENCE BOOKS

1.  Arijit Saha, Nilotpal Manna, Surajit Mandal, Information Theory, Coding and cryptography, Pearson India, 2013.

2.  Cover Thomas and Joy Thomas, Elements of Information Theory, Wiley India Pvt. Ltd. 2nd Edition, 2006.

3.  Salvatore Gravano, Introduction to errorControl Codes, Oxford Univ. Press, 2017.

4.  S. Lin and D. J. Costello, “Error Control Coding”, 2nd Edition, Pearson Prentice Hall, 2004.

5.  Simon Haykin, “Communication systems”, John Wiley & Sons, 2008.