Jan Konečný - Výuka - KMI/TIKO, KMI/TINF Teorie informace a kódování
Obsah
Úvod, základní pojmy z pravděpodobnosti, entropie, informace,
asymptoticka rovnočetnost typických zpráv,
kódování a komprese informace,
rychlost informace ze stacionárních zdrojů,
informační kanály, přenesitelnost,
věty o zachování a zpracování informace,
univerzální komprese zdrojů, Fisherova informace.
Rozvrh předmětu
Přednáška: úterý: 13:15 - 14:45
Cvičení: útery: 15:00 - 15:44
Doporučená literatura
- Cover T. M. Elements of Information Theory. J. Wiley,
2006. ISBN 0471241954.
- Adámek J. Kódování. SNTL Praha, 1989.
- Yeung, R. W. A First Course in Information Theory. Springer,
New York, USA, 2002.
- Adámek J. Foundations of Coding. Wiley-Interscience,
1991. ISBN 0471621874.
- Ash R. Information Theory. Dover, New York, 1965. ISBN
0-486-66521.
Studijní a výukové materiály
- slides, lesson 1
(changelog:
03-10-2020: removed the part which was not covered in the class;
26-09-2020: a few pages at the end removed;
24-09-2020: fixed minor mistakes observed during the lesson;
22-09-2020: published)
- slides, lesson 2
(en)
(changelog:
03-10-2020: fixed minor mistakes observed during the lesson, removed the part which was not covered in the class;
28-09-2020: english version published, minor typos fixed;
26-09-2020: published)
- slides, lesson 3
(en)
(changelog:
06-10-2020: published;
09-10-2020: fixed mistakes observed during the lesson, fixed terminology in the english version)
- slides, lesson 4
(en)
(changelog:
14-10-2020: fixed mistakes observed during the recording -- cz only, en version was OK;
13-10-2020: published)
video, lesson 4 (cz only)
(changelog:
14-10-2020: published)
- slides, lesson 5
(en)
(changelog:
20-10-2020: fixed terminology and some typos;
19-10-2020: published)
video, lesson 5 (cz only)
(changelog:
21-10-2020: published)
- slides, lesson 6
(en)
(changelog:
30-10-2020: fixed a few mistakes;
27-10-2020: published)
exercise(en)
(changelog:
03-11-2020: english version published, minor typos fixed;
30-10-2020: published)
video, lesson 6 (cz only)
(changelog:
30-10-2020: published)
-
slides, lesson 7 and 8
(en)
(changelog:
10-11-2020: fixed fonts in math (boldface math symbol not typed correctly)
06-11-2020: english version published;
03-11-2020: czech version published)
video, lessons 7 and 8 (cz only)
(changelog:
10-11-2020: published)
-
slides, lesson 9
(en)
(changelog:
26-11-2020: fixed a few mistakes;
24-11-2020: published)
video, lesson 9 (cz only)
(changelog:
30-11-2020: published)
exercise(en)
(changelog:
30-11-2020: published)
-
slides, lesson 10 (en)
(changelog:
07-12-2020: english version published, some mistakes in czech version fixed;
01-12-2020: czech version published)
-
slides, lesson 11
(changelog:
01-12-2020: published)
Reading assignments
- 22.9.2020 -- some Claude Shannon biography; Introduction to probability, properties of logarithms (if needed)
- 29.9.2020 -- generalized entropy (cz|en)
Zkouška
ústní formou.
Požadavky na zápočet
zisk dostatečného skóre ve dvou písemných testech
(nebo vypracování domácího úkolu v případe případě uzavření škol)