fireballoon
commited on
Commit
•
dbd619f
1
Parent(s):
a1cfe30
Update README.md
Browse files
README.md
CHANGED
@@ -12,10 +12,10 @@ datasets:
|
|
12 |
|
13 |
# baichuan-vicuna-chinese-7b-gptq
|
14 |
|
15 |
-
|
16 |
|
|
|
17 |
|
18 |
-
[baichuan-vicuna-chinese-7b](https://huggingface.co/fireballoon/baichuan-vicuna-chinese-7b) quantized with [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).
|
19 |
|
20 |
# Quantize config
|
21 |
```
|
|
|
12 |
|
13 |
# baichuan-vicuna-chinese-7b-gptq
|
14 |
|
15 |
+
[baichuan-vicuna-chinese-7b](https://huggingface.co/fireballoon/baichuan-vicuna-chinese-7b) quantized with [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).
|
16 |
|
17 |
+
使用[AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ)量化的[baichuan-vicuna-chinese-7b](https://huggingface.co/fireballoon/baichuan-vicuna-chinese-7b)。使用7G显存实现模型推理。
|
18 |
|
|
|
19 |
|
20 |
# Quantize config
|
21 |
```
|