---
datasets:
- Norquinal/claude_multiround_chat_1k
---

AWQ quant with `pileeval` of [Norquinal/Mistral-7B-claude-chat](https://huggingface.co/Norquinal/Mistral-7B-claude-chat)

```json
{ "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
```