mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ
Text Generation
•
Updated
•
22
•
2
Llama2 HQQ Quantized Models
LLama2 models quantized using https://github.com/mobiusml/hqq
-
-
mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ
Text Generation • Updated • 19 • 1 -
mobiuslabsgmbh/Llama-2-70b-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 21 • 2 -
mobiuslabsgmbh/Llama-2-70b-chat-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 12 • 3 -
mobiuslabsgmbh/Llama-2-7b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 7 • 3 -
mobiuslabsgmbh/Llama-2-13b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 10 • 1