Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mobiuslabsgmbh
's Collections
Llama2-7B HQQ+
Aana
Mixtral HQQ Meta-Offloading
Llama2 HQQ Quantized Models
Mixtral HQQ Quantized Models
ViT HQQ Quantized Models
Llama2 HQQ Quantized Models
updated
Mar 29
LLama2 models quantized using https://github.com/mobiusml/hqq
Upvote
4
mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ
Text Generation
•
Updated
Dec 2, 2023
•
7
•
2
mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ
Text Generation
•
Updated
Dec 2, 2023
•
5
•
1
mobiuslabsgmbh/Llama-2-70b-hf-2bit_g16_s128-HQQ
Text Generation
•
Updated
Dec 2, 2023
•
12
•
2
mobiuslabsgmbh/Llama-2-70b-chat-hf-2bit_g16_s128-HQQ
Text Generation
•
Updated
Dec 2, 2023
•
12
•
3
mobiuslabsgmbh/Llama-2-7b-chat-hf-4bit_g64-HQQ
Text Generation
•
Updated
Dec 2, 2023
•
8
•
3
mobiuslabsgmbh/Llama-2-13b-chat-hf-4bit_g64-HQQ
Text Generation
•
Updated
Dec 2, 2023
•
4
•
1
Upvote
4
Share collection
View history
Collection guide
Browse collections