mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ
Text Generation
•
Updated
•
23
•
2
Llama2 HQQ Quantized Models
LLama2 models quantized using https://github.com/mobiusml/hqq
-
-
mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ
Text Generation • Updated • 12 • 1 -
mobiuslabsgmbh/Llama-2-70b-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 17 • 2 -
mobiuslabsgmbh/Llama-2-70b-chat-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 33 • 3 -
mobiuslabsgmbh/Llama-2-7b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 27 • 3 -
mobiuslabsgmbh/Llama-2-13b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 10 • 1