Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

this is the initial model warmstarted from openllama 3b v2 with the expert layers copied from models trained with lora on only the mlp layers, if you can find the problem with the modeling code i will send you a picture of my cat

Downloads last month
4
Inference Examples
Inference API (serverless) does not yet support model repos that contain custom code.

Collection including crumb/test-00-switchllama-i3b-f10b-e4-init