What is this model?
#1
by
Yuuru
- opened
Just that. I don't understand. Could anyone share some insight.
Mistral publish 3 base models, one for embedding too and instruct
This is for unit testing only.
Correct, it's for testing. That's why I put it on TheBlokeAI, not TheBloke. Any repos I add to TheBlokeAI are usually just for testing/experimentation and not for general use.
The base model is here: hf-internal-testing_mixtral-tiny . They created it for testing transformers code with the new Mixtral model format, in a small model that won't take ages to load and be slow to do inference.
I then used it to test the PR for making GPTQs of this model.
EDIT: I forgot that my full README template got applied to this model. I've removed it now.