aws-neuron
/

zephyr-7b-seqlen-2048-bs-4-cores-2

Text Generation

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Community

philschmid HF staff commited on Jan 31

Commit

cb0ac8f

•

1 Parent(s): 631d39a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -198,7 +198,7 @@ _coming soon_
 ```python
 from optimum.neuron import pipeline
-p = pipeline('text-generation', 'aws-neuron/zephyr-7b-seqlen-2048-bs-4-cores-2')
 # We use the tokenizer's chat template to format each message - see https://huggingface.co/docs/transformers/main/en/chat_templating
 messages = [
     {

 ```python
 from optimum.neuron import pipeline
+pipe = pipeline('text-generation', 'aws-neuron/zephyr-7b-seqlen-2048-bs-4-cores-2')
 # We use the tokenizer's chat template to format each message - see https://huggingface.co/docs/transformers/main/en/chat_templating
 messages = [
     {