Hugging Face's logo

GreenBitAI
/
Qwen-1.5-32B-channel-mix-bpw-2.5

Text Generation
Transformers
Safetensors
qwen2
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

GreenBit LLMs

This is GreenBitAI's pretrained low-bit LLMs with extreme compression yet still strong performance.

Please refer to our Github page for the code to run the model and more information.

Downloads last month
2
Safetensors
Model size
4.44B params
Tensor type
I32
·
FP16
·
I16
·
Inference API
Text Generation
Examples
Input a message to start chatting with GreenBitAI/Qwen-1.5-32B-channel-mix-bpw-2.5.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.

Collection including GreenBitAI/Qwen-1.5-32B-channel-mix-bpw-2.5