bigstorm/dolphin-2.9.2-qwen2-72b-6.0bpw-exl2
Text Generation
•
Updated
•
13
•
1
General ExLLamaV2 (exl2) Quants
Higher end quants to preserve model quality. Built for TabbyAPI and other exllamav2 supporting inference engines. Ready to deploy.
-
-
bigstorm/dolphin-2.9.1-llama-3-70b-6.0bpw-exl2
Text Generation • Updated • 14 • 3 -
bigstorm/Hermes-2-Theta-Llama-3-8B-8.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/Yi-1.5-34B-Chat-16K-8.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/Codestral-22B-v0.1-8.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/dolphin-2.9.2-qwen2-72b-7.0bpw-8hb-exl2
Text Generation • Updated • 15 • 2 -
bigstorm/Hermes-2-Theta-Llama-3-70B-7.0bpw-8hb-exl2
Text Generation • Updated • 6 -
bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2
Text Generation • Updated • 8 -
bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2
Text Generation • Updated • 13 -
bigstorm/Mixtral-8x22B-Instruct-v0.1-7.0bpw-8hb-exl2
Updated -
bigstorm/gemma-2-27b-it-8.0bpw-8hb-exl2
Text Generation • Updated • 19 -
bigstorm/Llama-3-Groq-8B-Tool-Use-8.0bpw-8hb-exl2
Text Generation • Updated • 15 -
bigstorm/Llama-3-Groq-70B-Tool-Use-8.0bpw-8hb-exl2
Text Generation • Updated • 16 -
bigstorm/Mistral-Nemo-Base-2407-8.0bpw-8hb-exl2
Text Generation • Updated • 10 -
bigstorm/Mistral-Nemo-Instruct-2407-8.0bpw-8hb-exl2
Text Generation • Updated • 15 -
bigstorm/Meta-Llama-3.1-70B-Instruct-8.0bpw-8hb-exl2
Text Generation • Updated • 115 -
bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2
Text Generation • Updated • 23 -
bigstorm/Meta-Llama-3.1-70B-Instruct-6.5bpw-8hb-exl2
Text Generation • Updated • 21 -
bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2
Updated