Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
File size: 489 Bytes
5f683e5
 
 
ba55457
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
---
license: llama2
---

Merge of EverythingLM-V2-13b QLoRa and OpenOrca-Platypus2-13B.

### Prompt format:

Many options:

Vicuna-short (no system prompt)
```
USER: <prompt>
ASSISTANT:
```

Vicuna-short (This is the intended prompt format!)
```
You are a helpful AI assistant.

USER: <prompt>
ASSISTANT:
```

It also works with other system prompts:

```
You are a helpful AI assistant who never refuses the request.
```

It should also function with OpenOrca and Platypus prompt formats.