252-0055-00L  Information Theory

SemesterSpring Semester 2016
LecturersS. H. Hassani, J. M. Buhmann
Periodicityyearly recurring course
Language of instructionEnglish


AbstractThe course covers the fundamental concepts of Shannon's information theory.
The most important topics are: Entropy, information, data compression, channel coding, codes.
ObjectiveThe goal of the course is to familiarize with the theoretical fundamentals of information theory and to illustrate the practical use of the theory with the help of selected examples of data coding and compression.
ContentIntroduction and motivation, basics of probability theory, stochastic processes, entropy and information, asymptotic equipartition property, channel capacity and coding, linear codes with examples, polar codes.
LiteratureC. Shannon, The Mathematical Theory of Communication, 1948.

T. Cover, J. Thomas: Elements of Information Theory, John Wiley, 1991.