upstage
/

llama-30b-instruct-2048

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Chanjun commited on Aug 1, 2023

Commit

b76245f

•

1 Parent(s): 1f3ef2b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -53,7 +53,7 @@ pipeline_tag: text-generation
 ## Usage
 - Tested on A100 80GB
-- Our model can handle up to 10k input tokens, thanks to the `rope_scaling` option
 ```python
 import torch

 ## Usage
 - Tested on A100 80GB
+- Our model can handle up to 10k+ input tokens, thanks to the `rope_scaling` option
 ```python
 import torch