227-0417-00L  Information Theory I

SemesterHerbstsemester 2020
DozierendeA. Lapidoth
Periodizitätjährlich wiederkehrende Veranstaltung
LehrspracheEnglisch


KurzbeschreibungThis course covers the basic concepts of information theory and of communication theory. Topics covered include the entropy rate of a source, mutual information, typical sequences, the asymptotic equi-partition property, Huffman coding, channel capacity, the channel coding theorem, the source-channel separation theorem, and feedback capacity.
LernzielThe fundamentals of Information Theory including Shannon's source coding and channel coding theorems
InhaltThe entropy rate of a source, Typical sequences, the asymptotic equi-partition property, the source coding theorem, Huffman coding, Arithmetic coding, channel capacity, the channel coding theorem, the source-channel separation theorem, feedback capacity
LiteraturT.M. Cover and J. Thomas, Elements of Information Theory (second edition)