mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ
Text Generation
•
Updated
•
13
•
2
Llama2 HQQ Quantized Models
LLama2 models quantized using https://github.com/mobiusml/hqq
-
-
mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ
Text Generation • Updated • 5 • 1 -
mobiuslabsgmbh/Llama-2-70b-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 7 • 2 -
mobiuslabsgmbh/Llama-2-70b-chat-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 5 • 3 -
mobiuslabsgmbh/Llama-2-7b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 8 • 3 -
mobiuslabsgmbh/Llama-2-13b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 13 • 1