What is entropy exactly?
Channel: Trang Le
Date: 2021-03-29

This is a guest lecture I recorded for the Foundations of Artificial Intelligence course (BMIN 520-001) directed by Dr. Ryan Urbanowicz at the University of Pennsylvania.

Slides: https://slides.com/trang1618/information-theory/

0:00 Introduction
0:57 Statistics review
4:05 Boltzmann entropy 
8:22 Shannon entropy
12:50 Other quantities in information theory
16:47 Mutual information Colab notebook: http://tiny.cc/mutual-info
19:01 Other applications
23:53 Resources