Number | Title | ECTS | Hours | Lecturers |
---|
252-0055-00L | Information Theory | 4 credits | 2V + 1U | S. H. Hassani,
J. M. Buhmann |
Abstract | The course covers the fundamental concepts of Shannon's information theory. The most important topics are: Entropy, information, data compression, channel coding, codes. |
Objective | The goal of the course is to familiarize with the theoretical fundamentals of information theory and to illustrate the practical use of the theory with the help of selected examples of data coding and compression. |
Content | Introduction and motivation, basics of probability theory, stochastic processes, entropy and information, asymptotic equipartition property, channel capacity and coding, linear codes with examples, polar codes. |
Literature | C. Shannon, The Mathematical Theory of Communication, 1948.
T. Cover, J. Thomas: Elements of Information Theory, John Wiley, 1991. |