Mixtral Instruct 8x22-v0.3
#3
by
ChuckMcSneed
- opened
Do Mixtral Instruct 8x22-v0.3 next https://models.mistralcdn.com/mixtral-8x22b-v0-3/mixtral-8x22B-Instruct-v0.3.tar
It seems to be the same as mixtral-0.1. What a shame.
https://github.com/mistralai/mistral-inference?tab=readme-ov-file#model-download
Do it if it isn't a problem for you, or wizard 8x22b, as it seems more interesting.
If possible with your ablation technique, I second the request for https://huggingface.co/alpindale/WizardLM-2-8x22B
That appears the more interesting of the MoE models.
Also would love to see WizardLM2 8x22B abliterated! If only my 64/8 ram/vram could handle a decent quant of it :(