Update README.md
Browse files
README.md
CHANGED
@@ -1,34 +1,31 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
|
7 |
-
|
8 |
-
|
9 |
-
|
10 |
-
|
11 |
-
|
12 |
-
|
13 |
-
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
-
|
18 |
-
|
19 |
-
|
20 |
-
|
21 |
-
|
22 |
-
-
|
23 |
-
-
|
24 |
-
-
|
25 |
-
-
|
26 |
-
-
|
27 |
-
-
|
28 |
-
|
29 |
-
*For more histories please turn to [here](docs/NEWS_OR_UPDATE.md)*
|
30 |
-
|
31 |
-
## Performance Comparison
|
32 |
|
33 |
### Inference Speed
|
34 |
> The result is generated using [this script](examples/benchmark/generation_speed.py), batch size of input is 1, decode strategy is beam search and enforce the model to generate 512 tokens, speed metric is tokens/s (the larger, the better).
|
@@ -336,4 +333,4 @@ pytest tests/ -s
|
|
336 |
- Specially thanks **qwopqwop200**, for code in this project that relevant to quantization are mainly referenced from [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/cuda).
|
337 |
|
338 |
|
339 |
-
[![Star History Chart](https://api.star-history.com/svg?repos=PanQiwei/AutoGPTQ&type=Date)](https://star-history.com/#PanQiWei/AutoGPTQ&Date)
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
datasets:
|
4 |
+
- PetraAI/PetraAI
|
5 |
+
language:
|
6 |
+
- ar
|
7 |
+
- en
|
8 |
+
- ch
|
9 |
+
- zh
|
10 |
+
metrics:
|
11 |
+
- accuracy
|
12 |
+
- bertscore
|
13 |
+
- bleu
|
14 |
+
- chrf
|
15 |
+
- code_eval
|
16 |
+
- brier_score
|
17 |
+
tags:
|
18 |
+
- chemistry
|
19 |
+
- biology
|
20 |
+
- finance
|
21 |
+
- legal
|
22 |
+
- music
|
23 |
+
- code
|
24 |
+
- art
|
25 |
+
- climate
|
26 |
+
- medical
|
27 |
+
- text-generation-inference
|
28 |
+
---
|
|
|
|
|
|
|
29 |
|
30 |
### Inference Speed
|
31 |
> The result is generated using [this script](examples/benchmark/generation_speed.py), batch size of input is 1, decode strategy is beam search and enforce the model to generate 512 tokens, speed metric is tokens/s (the larger, the better).
|
|
|
333 |
- Specially thanks **qwopqwop200**, for code in this project that relevant to quantization are mainly referenced from [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/cuda).
|
334 |
|
335 |
|
336 |
+
[![Star History Chart](https://api.star-history.com/svg?repos=PanQiwei/AutoGPTQ&type=Date)](https://star-history.com/#PanQiWei/AutoGPTQ&Date)
|