add chat template

README.md

@@ -45,12 +45,25 @@ ReflectionCoder is a novel approach that effectively leverages reflection sequen
 Following chat templates of most models, we use two special tokens to wrap the message of user and assistant, *i.e.*, ``<|user|>``, ``<|assistant|>``, and ``<|endofmessage|>``. Furthermore, we use two special tokens to wrap the content of different blocks, *i.e.*,  ``<|text|>`` and ``<|endofblock|>``. You can use the following template to prompt our ReflectionCoder.
 
 ```python
-<|user|><|text|> 
-Your Instruction
-<|endofblock|><|endofmessage|><|assistant|>
+import torch
+from transformers import pipeline
+
+chat = [
+    {"role": "user", "content": "<Your code instruction here>"}
+]
+
+generator = pipeline(
+    model="SenseLLM/ReflectionCoder-CL-34B",
+    task="text-generation",
+    torch_dtype=torch.bfloat16,
+    device_map="auto",
+)
+
+result = generator(chat, max_length=128, num_return_sequences=1)
+
+print(result)
 ```
 
-#### Inference Code
 Please refer to our [GitHub Repo](https://github.com/SenseLLM/ReflectionCoder) for more technical details.
 
 ## Citation

tokenizer_config.json

@@ -142,5 +142,6 @@
   "suffix_token": "▁<SUF>",
   "tokenizer_class": "CodeLlamaTokenizer",
   "unk_token": "<unk>",
-  "use_default_system_prompt": false
+  "use_default_system_prompt": false,
+  "chat_template": "{% for message in messages %}{% if message['role'] == 'user' %}{{ '<|user|>' }}{% elif message['role'] == 'system' %}{{ '<|system|>' }}{% elif message['role'] == 'assistant' %}{{ '<|assistant|>' }}{% endif %}{% if message['content'] is string %}{{ '<|text|>' + message['content'] + '<|endofblock|>' }}{% elif message['content'] is sequence %}{% for block in message['content'] %}{% if block['type'] == 'text' %}{{ '<|text|>' }}{% elif block['type'] == 'code' %}{{ '<|code|>' }}{% elif block['type'] == 'execution' %}{{ '<|execution|>' }}{% endif %}{{ block['content'] + '<|endofblock|>' }}{% endfor %}{% endif %}{{ '<|endofmessage|>' }}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>' }}{% endif %}"
 }