OpenSourceRonin commited on
Commit
539d7e0
1 Parent(s): 1d69b8b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -5
README.md CHANGED
@@ -1,5 +1,33 @@
1
- ---
2
- license: other
3
- license_name: qwen
4
- license_link: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/blob/main/LICENSE
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: qwen
4
+ license_link: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/blob/main/LICENSE
5
+ ---
6
+
7
+ **Disclaimer**:
8
+
9
+ The model is reproduced based on the paper *VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models* [github](https://github.com/microsoft/vptq) and [arXiv](https://arxiv.org/abs/2409.17066)
10
+
11
+ The model itself is sourced from a community release.
12
+
13
+ It is intended only for experimental purposes.
14
+
15
+ Users are responsible for any consequences arising from the use of this model.
16
+
17
+ **Note**:
18
+
19
+ The PPL test results are for reference only and were collected using GPTQ testing script.
20
+
21
+ ```json
22
+ {
23
+ "ctx_2048": {
24
+ "wikitext2": 6.2918500900268555
25
+ },
26
+ "ctx_4096": {
27
+ "wikitext2": 5.835848808288574
28
+ },
29
+ "ctx_8192": {
30
+ "wikitext2": 5.622518062591553
31
+ }
32
+ }
33
+ ```