YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Credits to Gazingstars123 for the detailed documentation about the expansion.
The model is provided as it is, no further updates are planned.
If you want to make it compatible with the inference engine, copy the missing keys from the previous complete layer that is closest to it.
Don't be a moron - share the missing keys between the blocks during training.
In its current form, the output should be exactly the same as the 2B model.
This is the opposite of what I have been doing for years, which is shrinking and looping through the model layers.
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support