Anthonyg5005 commited on
Commit
3eefe99
1 Parent(s): 2511b05

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -18
README.md CHANGED
@@ -1,18 +1,30 @@
1
- # Exl2 quants for [Qwen1.5-0.5B-Chat](https://huggingface.co/Qwen/Qwen1.5-0.5B-Chat)
2
-
3
- ## Automatically quantized using the auto quant from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
4
-
5
- Would recommend Anthonyg5005 to change up this README to include more info.
6
-
7
- ### BPW:
8
-
9
- [2.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/2.0bpw)\
10
- [2.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/2.5bpw)\
11
- [3.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/3.0bpw)\
12
- [3.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/3.5bpw)\
13
- [4.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/4.0bpw)\
14
- [4.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/4.5bpw)\
15
- [5.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/5.0bpw)\
16
- [5.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/5.5bpw)\
17
- [6.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/6.0bpw)\
18
- [measurement.json](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/raw/main/measurement.json)
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: tongyi-qianwen-research
4
+ license_link: >-
5
+ https://huggingface.co/Qwen/Qwen1.5-0.5B-Chat/blob/main/LICENSE
6
+ language:
7
+ - en
8
+ library_name: ExLlamaV2
9
+ pipeline_tag: text-generation
10
+ tags:
11
+ - chat
12
+ ---
13
+ # Exl2 quants for [Qwen1.5-0.5B-Chat](https://huggingface.co/Qwen/Qwen1.5-0.5B-Chat)
14
+
15
+ ## Automatically quantized using the auto quant from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
16
+
17
+ Created as an example for [Auto EXL2 HF upload](https://huggingface.co/Anthonyg5005/hf-scripts/resolve/main/auto-exl2-upload/auto-exl2-upload.zip?download=true)
18
+
19
+ ### BPW:
20
+
21
+ [2.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/2.0bpw)\
22
+ [2.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/2.5bpw)\
23
+ [3.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/3.0bpw)\
24
+ [3.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/3.5bpw)\
25
+ [4.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/4.0bpw)\
26
+ [4.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/4.5bpw)\
27
+ [5.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/5.0bpw)\
28
+ [5.5](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/5.5bpw)\
29
+ [6.0](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/tree/6.0bpw)\
30
+ [measurement.json](https://huggingface.co/Anthonyg5005/Qwen1.5-0.5B-Chat-exl2/resolve/main/measurement.json?download=true)