llmixer's picture
Create README.md
acd7cce verified
---
license: llama2
language:
- en
pipeline_tag: conversational
tags:
- 4.0bpw
- h8
- exl2
---
Exllamav2 4.0bpw h8 quant for [BigWeave-v8-90b](https://huggingface.co/llmixer/BigWeave-v8-90b).
Calibration dataset: [llmixer/20k_random_data](https://huggingface.co/datasets/llmixer/20k_random_data)