File size: 379 Bytes
7e43af0 0b8e768 |
1 2 3 4 5 6 7 8 |
---
license: mit
---
This is an instruct model. It's to test out the effects of my dataset on the InternLM model if you just change everything to say "Llama" instead of "InternLM" in the config files.
I had a theory that a lot of these models are just Llama models with extraneous loaders. This is to test that theory.
Trained at rank 256 for 1 epoch at constant learning rate. |