Hugging Face's logo

cshared
/
Qwen-QwQ-32B-4.0bpw-exl2

Text Generation
Safetensors
qwen2
conversational
4-bit precision
exl2
Model card Files Community
cshared commited on
Commit
1f60124
·
verified ·
1 Parent(s): 9ed2635

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -12,7 +12,7 @@ Original Model: https://huggingface.co/Qwen/QwQ-32B
12
  | --- | --- |
13
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-8.0bpw-exl2">**8.0bpw**</a> | 33.5 GB |
14
  | ~7.0bpw~ | WIP |
15
- | ~6.5bpw~ | WIP |
16
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">**6.0bpw**</a> | 25.6 GB |
17
  | ~5.5bpw~ | WIP |
18
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.0bpw-exl2">**5.0bpw**</a> | 21.7 GB |
 
12
  | --- | --- |
13
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-8.0bpw-exl2">**8.0bpw**</a> | 33.5 GB |
14
  | ~7.0bpw~ | WIP |
15
+ | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.5bpw-exl2">**6.5bpw**</a> | 27.5 GB |
16
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-6.0bpw-exl2">**6.0bpw**</a> | 25.6 GB |
17
  | ~5.5bpw~ | WIP |
18
  | <a href="https://huggingface.co/cshared/Qwen-QwQ-32B-5.0bpw-exl2">**5.0bpw**</a> | 21.7 GB |