GitHub repository: marius-sm/on_layer_norm_in_transformers
Primary language: Jupyter Notebook
Description: A notebook comparing Post-LN and Pre-LN in BERT