Live coding 10
Channel: Jeremy Howard
Date: 23/07/2022

About these sessions: https://forums.fast.ai/t/live-coding-aka-walk-thrus/96617. Playlist: https://www.youtube.com/playlist?list=PLfYUBJiXbdtSLBPJ1GMx-sQWf6iNhb8mM. Contents:

00:00 - Questions
06:00 - Steps for Entering a Standard Image Recognition Competition on Kaggle
08:40 - The best models for fine tuning image recognition
12:00 - Thomas Capelle script to run experiments
14:00 - Github Gist
16:00 - Weights and Biases API
17:00 - Automating Gist generation
20:30 - Summarising and ranking models for fine tuning
23:00 - Scatter plot of performance by model family
25:40 - Best models for images that don't look like Imagenet
33:00 - Pretrained models - Model Zoo, Papers With Code, Huggingface
37:30 - Applying learning on Paddy notebook with small models
46:00 - Applying learning on large models
47:00 - Gradient accumulation to prevent out of memory
52:50 - Majority vote