Text Generation
Transformers
Safetensors
llama
llama-3
bagel
conversational
Inference Endpoints
text-generation-inference
jondurbin commited on
Commit
b7f4d46
1 Parent(s): dc7debc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -326,7 +326,7 @@ print(tokenizer.apply_chat_template(chat, tokenize=False))
326
  Prompt:
327
 
328
  ```text
329
- [INST] <<SYS>>
330
  You are a helpful assistant with access to the following functions. Use them if required -
331
  {
332
  "name": "generate_random_name",
@@ -344,10 +344,10 @@ print(tokenizer.apply_chat_template(chat, tokenize=False))
344
  ]
345
  }
346
  }
347
- <</SYS>>
348
-
349
- I need a random male name for my novel's character. [/INST]
350
- ```
351
 
352
  Response:
353
 
@@ -358,12 +358,12 @@ print(tokenizer.apply_chat_template(chat, tokenize=False))
358
  Then, you re-prompt the model with the function response.
359
 
360
  ```text
361
- [INST] <|begin_func_response|>{"name": "James"}<|end_func_response|>
362
  ```
363
 
364
  Which has a response of:
365
  ```text
366
- How about the name "James" for your novel's character? </s><s>[INST] That sounds good. Now, I need a female name too.
367
  ```
368
  </details>
369
 
 
326
  Prompt:
327
 
328
  ```text
329
+ <|start_header_id|>system<|end_header_id|>
330
  You are a helpful assistant with access to the following functions. Use them if required -
331
  {
332
  "name": "generate_random_name",
 
344
  ]
345
  }
346
  }
347
+ <|eot_id|>
348
+ <|start_header_id|>user<|end_header_id|>
349
+ I need a random male name for my novel's character.<|eot_id|>
350
+ <|start_header_id|>assistant<|end_header_id|>
351
 
352
  Response:
353
 
 
358
  Then, you re-prompt the model with the function response.
359
 
360
  ```text
361
+ <|begin_func_response|>{"name": "James"}<|end_func_response|>
362
  ```
363
 
364
  Which has a response of:
365
  ```text
366
+ How about the name "James" for your novel's character?
367
  ```
368
  </details>
369