0

(

ratings

)

students

Created by:

Profile Photo

Last updated:

September 25, 2023

Duration:

Unlimited Duration

FREE

This course includes:

Unlimited Duration

Badge on Completion

Certificate of completion

Unlimited Duration

Description

An Introduction to Information Theory. Instructor: Prof. Adrish Banerjee, Department of Electrical Engineering, IIT Kanpur.

Information Theory answers two fundamental questions: what is the maximum data rate at which we can transmit over a communication link, and what is the fundamental limit of data compression. In this course we will explore answers to these two questions. We will study some practical source compression algorithms. We will also study how to compute channel capacity of simple channels. (from nptel.ac.in)

Course Curriculum

  • Lecture 01 – Introduction Unlimited
  • Lecture 02 – Measure Information Unlimited
  • Lecture 03 – Information Inequalities Unlimited
  • Lecture 04 – Problem Solving Session I Unlimited
  • Lecture 05 – Block to Variable Length Coding: Prefix Free Code Unlimited
  • Lecture 06 – Block to Variable Length Coding: Bounds on Optimal Code Length Unlimited
  • Lecture 07 – Block to Variable Length Coding: Huffman Coding Unlimited
  • Lecture 08 – Variable to Block Length Coding Unlimited
  • Lecture 09 – The Asymptotic Equipartition Property Unlimited
  • Lecture 10 – Block to Block Coding of DMS (Discrete Memoryless Source) Unlimited
  • Lecture 11 – Problem Solving Session II Unlimited
  • Lecture 12 – Universal Source Coding: Lempel-Ziv Algorithm – LZ77 Unlimited
  • Lecture 13 – Universal Source Coding: Lempel-Ziv Welch Algorithm (LZW) Unlimited
  • Lecture 14 – Coding of Sources with Memory Unlimited
  • Lecture 15 – Channel Capacity Unlimited
  • Lecture 16 – Jointly Typical Sequences Unlimited
  • Lecture 17 – Noisy Channel Coding Theorem Unlimited
  • Lecture 18 – Differential Entropy Unlimited
  • Lecture 19 – Gaussian Channel Unlimited
  • Lecture 20 – Parallel Gaussian Channel Unlimited
  • Lecture 21 – Problem Solving Session III Unlimited
  • Lecture 22 – Rate Distortion Theory Unlimited
  • Lecture 23 – Blahut-Arimoto Algorithm Unlimited
  • Lecture 24 – Problem Solving Session IV Unlimited

About the instructor

5 5

Instructor Rating

6

Reviews

4637

Courses

24154

Students

Profile Photo
OpenCoursa
We are an educational and skills marketplace to accommodate the needs of skills enhancement and free equal education across the globe to the millions. We are bringing courses and trainings every single day for our users. We welcome everyone woth all ages, all background to learn. There is so much available to learn and deliver to the people.