---
license: bsd-3-clause
---
Hyena Hierarchy: Towards Larger Convolutional Language Models: https://arxiv.org/abs/2302.10866

Hyena small, trained for 150 billion tokens on The Pile. See: https://github.com/HazyResearch/safari/blob/main/experiments.md for more information!