bigquant's picture
Update README.md
e98156f verified
---
library_name: transformers
tags:
- AWQ
- Miqu
- Senku
---
A quantized version of [Shinoji Research's Senku 70B Full](https://huggingface.co/ShinojiResearch/Senku-70B-Full). Quantized through AWQ:
Quantization settings:
```
{"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
```