Extreme low-bit quantization with HQQ+ (HQQ + LoRA adapter)
![Mobius Labs GmbH's profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
Mobius Labs GmbH
company
AI & ML interests
Computer Vision, LLMs, Multimodal Models, Model Compression
Organization Card
About org cards
Multimodal AI on a global scale. Advocates for Open Source and Open Intelligence. Currently investigating how to make Large Machine Learning Models smaller and democratize them for GPU-poor environments. Visit https://mobiusml.github.io/blog/ to see some of our recent work.
models
20
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Llama-2-7b-chat-hf_4bitnogs_hqq
Text Generation
•
Updated
•
4
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Llama-2-7b-chat-hf_2bitgs8_hqq
Text Generation
•
Updated
•
12
•
34
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Llama-2-7b-chat-hf_1bitgs8_hqq
Text Generation
•
Updated
•
50
•
74
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/aanaphi2-v0.1
Text Generation
•
Updated
•
1.22k
•
27
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-3bit-metaoffload-HQQ
Text Generation
•
Updated
•
7
•
13
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bitgs8-metaoffload-HQQ
Text Generation
•
Updated
•
3
•
20
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ
Text Generation
•
Updated
•
3
•
15
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Mixtral-8x7B-v0.1-hf-2bit_g16_s128-HQQ
Text Generation
•
Updated
•
1
•
4
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Mixtral-8x7B-v0.1-hf-attn-4bit-moe-2bit-HQQ
Text Generation
•
Updated
•
1
•
6
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64d3793b508a6313e31d2dc0/uUBBp80u9X1sZBktRijM8.png)
mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1-hf-2bit_g16_s128-HQQ
Text Generation
•
Updated
•
3
•
9