Anthonyg5005's picture
Update README.md
a084aa1 verified
metadata
license: other
license_name: tongyi-qianwen-research
license_link: https://huggingface.co/Qwen/Qwen1.5-0.5B-Chat/blob/main/LICENSE
language:
  - en
library_name: ExLlamaV2
pipeline_tag: text-generation
tags:
  - chat

Exl2 quants for Qwen1.5-0.5B-Chat

Automatically quantized using the auto quant script from hf-scripts

Created as an example for Auto EXL2 HF upload

BPW:

2.0
2.5
3.0
3.5
4.0
4.5
5.0
5.5
6.0
measurement.json