Information Theory and Source Coding

Sie verwenden einen Browser, in dem JavaScript deaktiviert ist. Dadurch wird verhindert, dass Sie die volle Funktionalität dieser Webseite nutzen können. Zur Navigation müssen Sie daher die Sitemap nutzen.

You are currently using a browser with deactivated JavaScript. There you can't use all the features of this website. In order to navigate the site, please use the Sitemap .

Lecturer: Dr. Christiane Antweiler

Contact: Tim SchmitzMatthias Schrammen

Type: Master CE lecture

Credits: 2

Campus Lecture
Campus Exercise
Learning room L2
(Registration via campusOffice)

Course language: English

Lecture notes and exercise problems are sold before the first lecture as well as by Irina Ronkartz.

All scripts and auxiliary sheets will also be available for download at the L²P learning room.



from Wednesday, Oct. 19th, 2016
08:30am - 10:00am
Seminar room 4G IKS


from Wednesday, Oct. 19th, 2016
10:15am - 11:00am
Seminar room 4G IKS

Consultation hours:

Wednesday, March 1st, 2017
02.00pm - 03:00pm
Seminar room 4G at IKS

Monday, March 6th, 2017
02.00pm - 03:00pm
Seminar room 4G at IKS

Wednesday, March 8th, 2017
02.00pm - 04:00pm
Seminar room 4G at IKS


Friday, March 10th, 2017
09:00am - 10:30am
Lecture room Ro Audimax

Exam duration: 90 minutes

Remarks: The exam in the winter term 2016/17 is in written form.

Resources: The exam is held with open books excluding programmable pocket calculators and communication devices.

Please note: Please bring along your student ID (BlueCard)!


Monday, April 24th, 2017
02.00pm - 03.00pm
Seminar room 4G at IKS

The lecture "Information Theory and Source Coding" is part of the Master programmes

  • Communications Engineering in Module C,
  • Simulation Sciences.


This one-semester course originally is part of the Master Programme Communications Engineering at RWTH. The lecture contents are basically organized in two blocks: On the one hand, the basics of Information Theory are introduced and applied to the field of data encoding. The theory comprises the following elements, accompanied by numerous examples:

  • Discrete memoryless sources and sources with memory
  • entropy, conditional entropy, and mutual information
  • entropy coding (Shannon code, Fano code, Huffman code, Facsimile)
  • and the performance limits of data compression

The second block extends Information Theory and establishes the principles of speech signal encoding. Eventually, the lecture leads to an overview of the state-of-the-art of speech coding technology and its applications, as for example mobile radio. The following topics are discussed in particular:

  • Continuous (analog) sources with memory
  • sampling and quantization of analog signals
  • introduction to rate-distortion theory
  • linear prediction theory and differential waveform coding
  • and an overview about the standards and applications of speech coding

The lecture is supported by weekly exercises. If the described course on "Information Theory and Source Coding" is combined with the course on "Forward Error Correction and Digital Modulation" (summer term), a comprehensive understanding of digital communication systems can be achieved.


The results of the evaluation of the last years are summarized below.

Winter term 2016/2017

Participants of the evaluation: 20
Global grade: 1.6
Concept of the lecture: 1.6
Instruction and behaviour: 1.6

Participants of the evaluation: 19
Global grade: 1.5
Concept of the exercise: 1.4
Instruction and behaviour: 1.5