Demixtral
Contains eight Mistral models using the MLP layers from the corresponding Mixtral expert. Note that the ordering of experts between layers is arbitrary, so this is not the only (and almost certainly not the best) extraction possible.
None of these are usable on their own. No coherent text will come out of any of these. This is purely for research and experimentation.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.