A Guide to A/B Testing as a Data Scientist!
Channel: CodeEmporium
Date: 2021-07-19

CODE: https://github.com/ajhalthor/bayesian-testing

REFERENCES
[1] Book on Bayesian Math: https://users.aalto.fi/~ave/BDA3.pdf
[2] Good blog to understand Beta Distribution: http://varianceexplained.org/statistics/beta_distribution_and_baseball/

SPONSOR
Kite is a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I've been using Kite. Love it! Learn more here:
https://www.kite.com/get-kite/?utm_medium=referral&utm_source=youtube&utm_campaign=codeemporium&utm_content=description-only

TIMESTAMPS
0:00 Introduction
0:47 Experiment Definition
3:00 Create Dataset for A/B Test
5:07 Hypothesis Testing
6:00 Issue of Interpretability 
8:09 Bayesian Testing: Constructing Prior
10:07 Bayesian Testing: Constructing Posterior
13:55 Introducing a Continuous Metric: Prices
14:25 Understand Pricing Distributions
16:04 Add prices to dataset
17:05 Bayesian Math
20:37 Coded Math
22:47 Construct Priors, Posteriors
25:42 Interpret Results for Continuous Metric