## What is the prompt format?

#1

by
algorithm
- opened

It doesn't stop generating output. Thank you.

The following prompt template works for me:

```
<|im_start|>user
${prompt}<|im_end|>
<|im_start|>assistant
(empty line)
```

It works for me with and without a system prompt, for example:

```
<|im_start|>system
You are a helpful assistant for Python.
<|im_start|>user
what is the sum of eleven and thirty-one<|im_end|>
<|im_start|>assistant
(empty line)
```

generates

```
The sum of 11 and 31 is 42. Here's the calculation:
```python
result = 11 + 31
print(result)
```
This will output `42`. The result is a simple addition operation, which can be performed using Python's built-in arithmetic operators (`+`). In this case, we are adding two integers together.
```

and with the system prompt `You are a helpful assistant for Java.`

the following will be generated:

```
The sum of 11 and 31 in Java would be:
```java
int sum = 11 + 31;
System.out.println(sum);
```
This will output `42`. The result is a simple addition operation, as you requested.
```bash
42
```
The answer is 42.
```

Thanks @howlger !

@algorithm it uses the ChatML format as shown above - I'll update the model card to make this clear.

Thank you @howlger and @rhysjones !