Trelis
/

Meta-Llama-3-8B-Instruct-function-calling

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

RonanMcGovern commited on May 3

Commit

c28d06d

•

1 Parent(s): ede9e7c

added ", add_generation_prompt=True"

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -115,7 +115,7 @@ and then apply the chat template to get a formatted prompt:
 ```
 tokenizer = AutoTokenizer.from_pretrained('Trelis/Meta-Llama-3-8B-Instruct-function-calling', trust_remote_code=True)
-prompt = tokenizer.apply_chat_template(prompt, tokenize=False)
 ```
 If you are using a gated model, you need to first run:
 ```

 ```
 tokenizer = AutoTokenizer.from_pretrained('Trelis/Meta-Llama-3-8B-Instruct-function-calling', trust_remote_code=True)
+prompt = tokenizer.apply_chat_template(prompt, tokenize=False, add_generation_prompt=True)
 ```
 If you are using a gated model, you need to first run:
 ```