Neural Compression — Lecture 01.2 — Symbol Codes
Channel: Tübingen Machine Learning
Date: 2023-04-29

Second video of the course "Data Compression With and Without Deep Probabilistic Models" by Prof. Robert Bamler at University of Tübingen (summer term of 2023).

Playlist for entire course: https://www.youtube.com/playlist?list=PL05umP7R6ij0KTBVxk00MKoQRMLTWUJh-
Course website (no login required): https://robamler.github.io/teaching/compress23

Lecture notes: https://robamler.github.io/teaching/compress23/lecture-notes-01.pdf
Problem Set 0: https://robamler.github.io/teaching/compress23/problem-set-00.zip
Problem Set 1: https://robamler.github.io/teaching/compress23/problem-set-01.zip
Solutions to Problem Set 0: https://robamler.github.io/teaching/compress23/problem-set-00-solutions.zip
Solutions to Problem Set 1: https://robamler.github.io/teaching/compress23/problem-set-01-solutions.zip

Video Chapters
0:00 Welcome
0:24 Recap from last video
0:37 Goal of this video
1:19 Notation
3:16 Symbol codes: definition
4:37 Examples of symbol codes
8:42 Unique decodability and prefix freeness
10:38 What's the best symbol code? 
11:32 Probabilistic model of the data source
12:33 Huffman coding
15:34 Outlook and problem sets

© Robert Bamler / University of Tübingen, 2023 CC BY-NC-SA 3.0