aws-neuron
/

Llama-2-7b-chat-hf-seqlen-2048-bs-4

Text Generation

text-generation-inference

Model card Files Files and versions Community

philschmid HF staff commited on Nov 9, 2023

Commit

b633fcc

•

1 Parent(s): f5b31f9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -40,7 +40,7 @@ _coming soon_
 from optimum.neuron import pipeline
 # Load pipeline from Hugging Face repository
-pipe = pipeline("text-generation", "meta-llama/Llama-2-7b-chat-hf")
 # We use the tokenizer's chat template to format each message - see https://huggingface.co/docs/transformers/main/en/chat_templating
 messages = [

 from optimum.neuron import pipeline
 # Load pipeline from Hugging Face repository
+pipe = pipeline("text-generation", "aws-neuron/Llama-2-7b-chat-hf-seqlen-2048-bs-4")
 # We use the tokenizer's chat template to format each message - see https://huggingface.co/docs/transformers/main/en/chat_templating
 messages = [