fireballoon
commited on
Commit
•
5e92279
1
Parent(s):
a396a39
Update README.md
Browse files
README.md
CHANGED
@@ -18,6 +18,13 @@ baichuan-vicuna-7b is a chat model supervised finetuned on vicuna sharegpt data.
|
|
18 |
|
19 |
[中文说明](#chinese-model-card)
|
20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
# Inference with FastChat
|
22 |
```
|
23 |
python3 -m fastchat.serve.cli --model-path fireballoon/baichuan-vicuna-7b
|
|
|
18 |
|
19 |
[中文说明](#chinese-model-card)
|
20 |
|
21 |
+
# Load model
|
22 |
+
```python
|
23 |
+
from transformers import AutoTokenizer, AutoModelForCausalLM
|
24 |
+
tokenizer = AutoTokenizer.from_pretrained("fireballoon/baichuan-vicuna-7b", use_fast=False)
|
25 |
+
model = AutoModelForCausalLM.from_pretrained("fireballoon/baichuan-vicuna-7b")
|
26 |
+
```
|
27 |
+
|
28 |
# Inference with FastChat
|
29 |
```
|
30 |
python3 -m fastchat.serve.cli --model-path fireballoon/baichuan-vicuna-7b
|