6.0 bit exl2 quant (8 vut head) of Fireworks Hermes 2.5 fine tune of Mixtral-8x22b
Use Vicuna prompt template
needs ~ 120GB vRam (2xA100 or 3X RTX 6000)
- Downloads last month
- 12
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.