Information Theory and Coding. Instructor: Prof. S. N. Merchant, Department of Electrical Engineering, IIT Bombay.
FREE
This course includes
Hours of videos
1138 years, 9 months
Units & Quizzes
41
Unlimited Lifetime access
Access on mobile app
Certificate of Completion
This course covers lessons on information theory and coding, entropy, block code and its properties, Shannon's theorem, huffman coding, Shannon-Fano-Elias coding, arithmetic coding, information channels, rate-distortion theory, Lloyd-Max Quantizer, vector quantization, and transform coding. (from nptel.ac.in)
Course Currilcum
- Lecture 01 – Introduction to Information Theory and Coding Unlimited
- Lecture 02 – Definition of Information Measure and Entropy Unlimited
- Lecture 03 – Extension of an Information Source and Markov Source Unlimited
- Lecture 04 – Adjoint of an Information Source, Joint and Conditional Information Measure Unlimited
- Lecture 05 – Properties of Joint and Conditional Information Measures and a Markov Source Unlimited
- Lecture 06 – Asymptotic Properties of Entropy and Problem Solving in Entropy Unlimited
- Lecture 07 – Block Code and its Properties Unlimited
- Lecture 08 – Instantaneous Code and its Properties Unlimited
- Lecture 09 – Kraft-Mcmillan Equality and Compact Codes Unlimited
- Lecture 10 – Shannon’s First Theorem Unlimited
- Lecture 11 – Coding Strategies and Introduction to Huffman Coding Unlimited
- Lecture 12 – Huffman Coding and Proof of its Optimality Unlimited
- Lecture 13 – Competitive Optimality of the Shannon Code Unlimited
- Lecture 14 – Non-Binary Huffman Code and Other Codes Unlimited
- Lecture 15 – Adaptive Huffman Coding, Part I Unlimited
- Lecture 16 – Adaptive Huffman Coding, Part II Unlimited
- Lecture 17 – Shannon-Fano-Elias Coding and Introduction to Arithmetic Coding Unlimited
- Lecture 18 – Arithmetic Coding, Part I Unlimited
- Lecture 19 – Arithmetic Coding, Part II Unlimited
- Lecture 20 – Introduction to Information Channels Unlimited
- Lecture 21 – Equivocation and Mutual Information Unlimited
- Lecture 22 – Properties of Different Information Channels Unlimited
- Lecture 23 – Reduction of Information Channels Unlimited
- Lecture 24 – Properties of Mutual Information and Introduction to Channel Capacity Unlimited
- Lecture 25 – Calculation of Channel Capacity for Different Information Channels Unlimited
- Lecture 26 – Shannon’s Second Theorem Unlimited
- Lecture 27 – Discussion on Error Free Communication over Noisy Channel Unlimited
- Lecture 28 – Error Free Communication over a Binary Symmetric Channel Unlimited
- Lecture 29 – Differential Entropy and Evaluation of Mutual Information for Continuous … Unlimited
- Lecture 30 – Channel Capacity of a Bandlimited Continuous Channel Unlimited
- Lecture 31 – Introduction to Rate-Distortion Theory Unlimited
- Lecture 32 – Definition and Properties of Rate-Distortion Functions Unlimited
- Lecture 33 – Calculation of Rate-Distortion Functions Unlimited
- Lecture 34 – Computational Approach for Calculation of Rate-Distortion Functions Unlimited
- Lecture 35 – Introduction to Quantization Unlimited
- Lecture 36 – Lloyd-Max Quantizer Unlimited
- Lecture 37 – Companded Quantization Unlimited
- Lecture 38 – Variable Length Coding and Problem Solving in Quantizer Design Unlimited
- Lecture 39 – Vector Quantization Unlimited
- Lecture 40 – Transform Coding, Part I Unlimited
- Lecture 41 – Transform Coding, Part II Unlimited
