|
--- |
|
language: |
|
- en |
|
--- |
|
This repo contains code and links for the [Flash normalization paper](https://arxiv.org/abs/2407.09577): |
|
* <a href="https://colab.research.google.com/github/OpenMachine-ai/transformer-tricks/blob/main/flash_normalization.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Colab" height="20"></a> |
|
* Paper: [arXiv](https://arxiv.org/abs/2407.09577), [HuggingFace paper page](https://huggingface.co/papers/2407.09577), and [latex](https://github.com/OpenMachine-ai/transformer-tricks/blob/main/latex/flash.tex) |
|
* See [here](https://github.com/OpenMachine-ai/transformer-tricks/tree/main) for more transformer tricks |
