jondurbin
/

airoboros-7b-gpt4-1.1

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

jondurbin commited on Jun 10, 2023

Commit

c9a8c2b

•

1 Parent(s): 1140002

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -42,8 +42,7 @@ Then, you can invoke it like so (after downloading the model):
 python -m fastchat.serve.cli
   --model-path airoboros-13b-gpt4 \
   --temperature 0.5 \
-  --max-new-tokens 4096 \
-  --conv-template vicuna_v1.1 \
   --no-history
 ```

 python -m fastchat.serve.cli
   --model-path airoboros-13b-gpt4 \
   --temperature 0.5 \
+  --max-new-tokens 2048 \
   --no-history
 ```