semvec/pypi-packages huggingface dataset:
faster-norm 0.3.0
A fast, yet specialized, RMSNorm/LayerNorm implementation
License: MIT
Requires Python: >=3.3

# faster-norm

A fast, yet specialized, RMSNorm/LayerNorm implementation

This library is under development. Currently, only some special cases are supported, and the performance is not yet fully optimized.

- [x] RMSNorm
- [x] LayerNorm
- [x] Float16 and BFloat16
- [ ] More data types
- [x] More shapes
- [x] Optimize for no wgrad
- [ ] Performance tuning
- [ ] Optimize compilation time


## Statement

This work was independently completed by me at home using my personal RTX 3080.