helloollel
commited on
Commit
•
b218985
1
Parent(s):
d30fcfd
Update README.md
Browse files
README.md
CHANGED
@@ -74,7 +74,7 @@ git clone https://huggingface.co/helloollel/vicuna-7b
|
|
74 |
After completing the installation, you can run FastChat with the following command:
|
75 |
|
76 |
```bash
|
77 |
-
python3 -m fastchat.serve.cli --model-
|
78 |
```
|
79 |
|
80 |
This will start the FastChat server using the `vicuna-7b` model.
|
@@ -201,7 +201,7 @@ args = dict(
|
|
201 |
device='cuda',
|
202 |
num_gpus='1',
|
203 |
load_8bit=True,
|
204 |
-
conv_template='
|
205 |
temperature=0.7,
|
206 |
max_new_tokens=512,
|
207 |
debug=False
|
|
|
74 |
After completing the installation, you can run FastChat with the following command:
|
75 |
|
76 |
```bash
|
77 |
+
python3 -m fastchat.serve.cli --model-path ./vicuna-7b
|
78 |
```
|
79 |
|
80 |
This will start the FastChat server using the `vicuna-7b` model.
|
|
|
201 |
device='cuda',
|
202 |
num_gpus='1',
|
203 |
load_8bit=True,
|
204 |
+
conv_template='vicuna_v1.1',
|
205 |
temperature=0.7,
|
206 |
max_new_tokens=512,
|
207 |
debug=False
|