5 Probability 1: Entropy, (Naive) Bayes, Cross-entropy loss (MLVU2019)
Channel: MLVU
Date: 2019-02-19

slides: https://mlvu.github.io/lectures/31.ProbabilisticModels1.annotated.pdf
course materials: https://mlvu.github.io

Apologies for the bad audio (and missing video). A technical mishap meant we had to improvise.

Today, we discuss probabilistic approaches to Machine Learning. We start by reviewing the basics of probability theory and information theory, and then discuss some approaches to probabilistic classification, including the (naive) Bayes classifier and logistic regression, which is a combination of a linear model, a sigmoid function and cross-entropy loss.