JustinLin610
commited on
Commit
•
50540d5
1
Parent(s):
3c00f93
Update README.md
Browse files
README.md
CHANGED
@@ -40,7 +40,7 @@ We advise you to clone [`llama.cpp`](https://github.com/ggerganov/llama.cpp) and
|
|
40 |
## How to use
|
41 |
Cloning the repo may be inefficient, and thus you can manually download the GGUF file that you need or use `huggingface-cli` (`pip install huggingface_hub`) as shown below:
|
42 |
```shell
|
43 |
-
huggingface-cli download Qwen/Qwen1.5-1_8B-Chat-GGUF
|
44 |
```
|
45 |
|
46 |
We demonstrate how to use `llama.cpp` to run Qwen1.5:
|
|
|
40 |
## How to use
|
41 |
Cloning the repo may be inefficient, and thus you can manually download the GGUF file that you need or use `huggingface-cli` (`pip install huggingface_hub`) as shown below:
|
42 |
```shell
|
43 |
+
huggingface-cli download Qwen/Qwen1.5-1_8B-Chat-GGUF qwen1_5-1_8b-chat-q8_0.gguf --local-dir . --local-dir-use-symlinks False
|
44 |
```
|
45 |
|
46 |
We demonstrate how to use `llama.cpp` to run Qwen1.5:
|