Text Generation
Transformers
Safetensors
phi-msft
custom_code
Inference Endpoints

What is the prompt format?

#1
by algorithm - opened

It doesn't stop generating output. Thank you.

The following prompt template works for me:

<|im_start|>user
${prompt}<|im_end|>
<|im_start|>assistant
(empty line)

It works for me with and without a system prompt, for example:

<|im_start|>system
You are a helpful assistant for Python.
<|im_start|>user
what is the sum of eleven and thirty-one<|im_end|>
<|im_start|>assistant
(empty line)

generates

The sum of 11 and 31 is 42. Here's the calculation:
```python
result = 11 + 31
print(result)
```
This will output `42`. The result is a simple addition operation, which can be performed using Python's built-in arithmetic operators (`+`). In this case, we are adding two integers together.

and with the system prompt You are a helpful assistant for Java. the following will be generated:

The sum of 11 and 31 in Java would be:

```java
int sum = 11 + 31;
System.out.println(sum);
```

This will output `42`. The result is a simple addition operation, as you requested.
```bash
42
```
The answer is 42.

Thanks @howlger !

@algorithm it uses the ChatML format as shown above - I'll update the model card to make this clear.

Thank you @howlger and @rhysjones !

Sign up or log in to comment