---
license: apache-2.0
---

Built with gpt-neox 2.0 library, with use_bias_in_attn_linear=False. currently debugging purposes only, yet.