0

(

ratings

)

students

Created by:

Profile Photo

Last updated:

September 25, 2023

Duration:

Unlimited Duration

FREE

This course includes:

Unlimited Duration

Badge on Completion

Certificate of completion

Unlimited Duration

Description

Information Theory and Coding. Instructor: Prof. S. N. Merchant, Department of Electrical Engineering, IIT Bombay.

This course covers lessons on information theory and coding, entropy, block code and its properties, Shannon's theorem, huffman coding, Shannon-Fano-Elias coding, arithmetic coding, information channels, rate-distortion theory, Lloyd-Max Quantizer, vector quantization, and transform coding. (from nptel.ac.in)

Course Curriculum

  • Lecture 01 – Introduction to Information Theory and Coding Unlimited
  • Lecture 02 – Definition of Information Measure and Entropy Unlimited
  • Lecture 03 – Extension of an Information Source and Markov Source Unlimited
  • Lecture 04 – Adjoint of an Information Source, Joint and Conditional Information Measure Unlimited
  • Lecture 05 – Properties of Joint and Conditional Information Measures and a Markov Source Unlimited
  • Lecture 06 – Asymptotic Properties of Entropy and Problem Solving in Entropy Unlimited
  • Lecture 07 – Block Code and its Properties Unlimited
  • Lecture 08 – Instantaneous Code and its Properties Unlimited
  • Lecture 09 – Kraft-Mcmillan Equality and Compact Codes Unlimited
  • Lecture 10 – Shannon’s First Theorem Unlimited
  • Lecture 11 – Coding Strategies and Introduction to Huffman Coding Unlimited
  • Lecture 12 – Huffman Coding and Proof of its Optimality Unlimited
  • Lecture 13 – Competitive Optimality of the Shannon Code Unlimited
  • Lecture 14 – Non-Binary Huffman Code and Other Codes Unlimited
  • Lecture 15 – Adaptive Huffman Coding, Part I Unlimited
  • Lecture 16 – Adaptive Huffman Coding, Part II Unlimited
  • Lecture 17 – Shannon-Fano-Elias Coding and Introduction to Arithmetic Coding Unlimited
  • Lecture 18 – Arithmetic Coding, Part I Unlimited
  • Lecture 19 – Arithmetic Coding, Part II Unlimited
  • Lecture 20 – Introduction to Information Channels Unlimited
  • Lecture 21 – Equivocation and Mutual Information Unlimited
  • Lecture 22 – Properties of Different Information Channels Unlimited
  • Lecture 23 – Reduction of Information Channels Unlimited
  • Lecture 24 – Properties of Mutual Information and Introduction to Channel Capacity Unlimited
  • Lecture 25 – Calculation of Channel Capacity for Different Information Channels Unlimited
  • Lecture 26 – Shannon’s Second Theorem Unlimited
  • Lecture 27 – Discussion on Error Free Communication over Noisy Channel Unlimited
  • Lecture 28 – Error Free Communication over a Binary Symmetric Channel Unlimited
  • Lecture 29 – Differential Entropy and Evaluation of Mutual Information for Continuous … Unlimited
  • Lecture 30 – Channel Capacity of a Bandlimited Continuous Channel Unlimited
  • Lecture 31 – Introduction to Rate-Distortion Theory Unlimited
  • Lecture 32 – Definition and Properties of Rate-Distortion Functions Unlimited
  • Lecture 33 – Calculation of Rate-Distortion Functions Unlimited
  • Lecture 34 – Computational Approach for Calculation of Rate-Distortion Functions Unlimited
  • Lecture 35 – Introduction to Quantization Unlimited
  • Lecture 36 – Lloyd-Max Quantizer Unlimited
  • Lecture 37 – Companded Quantization Unlimited
  • Lecture 38 – Variable Length Coding and Problem Solving in Quantizer Design Unlimited
  • Lecture 39 – Vector Quantization Unlimited
  • Lecture 40 – Transform Coding, Part I Unlimited
  • Lecture 41 – Transform Coding, Part II Unlimited

About the instructor

5 5

Instructor Rating

6

Reviews

4637

Courses

24151

Students

Profile Photo
OpenCoursa
We are an educational and skills marketplace to accommodate the needs of skills enhancement and free equal education across the globe to the millions. We are bringing courses and trainings every single day for our users. We welcome everyone woth all ages, all background to learn. There is so much available to learn and deliver to the people.