Text Generation
Transformers
PyTorch
Chinese
English
llama
text-generation-inference
fireballoon commited on
Commit
5e92279
1 Parent(s): a396a39

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -18,6 +18,13 @@ baichuan-vicuna-7b is a chat model supervised finetuned on vicuna sharegpt data.
18
 
19
  [中文说明](#chinese-model-card)
20
 
 
 
 
 
 
 
 
21
  # Inference with FastChat
22
  ```
23
  python3 -m fastchat.serve.cli --model-path fireballoon/baichuan-vicuna-7b
 
18
 
19
  [中文说明](#chinese-model-card)
20
 
21
+ # Load model
22
+ ```python
23
+ from transformers import AutoTokenizer, AutoModelForCausalLM
24
+ tokenizer = AutoTokenizer.from_pretrained("fireballoon/baichuan-vicuna-7b", use_fast=False)
25
+ model = AutoModelForCausalLM.from_pretrained("fireballoon/baichuan-vicuna-7b")
26
+ ```
27
+
28
  # Inference with FastChat
29
  ```
30
  python3 -m fastchat.serve.cli --model-path fireballoon/baichuan-vicuna-7b