Hugging Face's logo

lmsys
/
longchat-13b-16k

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Model card Files Community
5
DachengLi commited on
Commit
45bb3f2
•
1 Parent(s): d98f55f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -7,9 +7,13 @@ inference: false
7
  ## Usage
8
  Please use load_model from FastChat or LongChat repo to load the model (or chatting API from FastChat). There is a monkey patch needed to use the model.
9
  Usage referece:
 
10
  (LongChat) python3 eval.py --model-name-or-path lmsys/longchat-13b-16k --task topics
 
11
  (FastChat) python3 -m fastchat.serve.cli --model-path lmsys/longchat-13b-16k
 
12
  Under the hood, the monkey patch is added in:
 
13
  https://github.com/lm-sys/FastChat/blob/da0641e567cf93756b0978ab5a6b092e96f06240/fastchat/model/model_adapter.py#L429
14
 
15
  ## Model details
 
7
  ## Usage
8
  Please use load_model from FastChat or LongChat repo to load the model (or chatting API from FastChat). There is a monkey patch needed to use the model.
9
  Usage referece:
10
+
11
  (LongChat) python3 eval.py --model-name-or-path lmsys/longchat-13b-16k --task topics
12
+
13
  (FastChat) python3 -m fastchat.serve.cli --model-path lmsys/longchat-13b-16k
14
+
15
  Under the hood, the monkey patch is added in:
16
+
17
  https://github.com/lm-sys/FastChat/blob/da0641e567cf93756b0978ab5a6b092e96f06240/fastchat/model/model_adapter.py#L429
18
 
19
  ## Model details