Edit model card

Built with Axolotl

Omega 2.6B

This model is derived from phi 1.3B using layer stacking techniques to double the number of hidden layers in the model. The model was then trained for 1 epoch on data from tiny-textbooks and tiny-lessons.



Downloads last month
Inference API (serverless) does not yet support model repos that contain custom code.

Datasets used to train winglian/omega-3b