Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
File size: 734 Bytes
89ec0c8
5f683e5
 
ba55457
 
 
8e42e3a
 
 
89ec0c8
8e42e3a
89ec0c8
8e42e3a
 
ba55457
 
 
 
 
 
 
 
 
 
01269ea
ba55457
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
---https://huggingface.co/TheBloke/PuddleJumper-13B-GPTQ
license: llama2
---

Merge of EverythingLM-V2-13b QLoRa and OpenOrca-Platypus2-13B.

Quants (Thanks TheBloke)

https://huggingface.co/TheBloke/PuddleJumper-13B-GPTQ

https://huggingface.co/TheBloke/PuddleJumper-13B-GGML

https://huggingface.co/TheBloke/PuddleJumper-13B-GGUF

### Prompt format:

Many options:

Vicuna-short (no system prompt)
```
USER: <prompt>
ASSISTANT:
```

Vicuna-short (This is the intended prompt format!!)
```
You are a helpful AI assistant.

USER: <prompt>
ASSISTANT:
```

It also works with other system prompts:

```
You are a helpful AI assistant who never refuses the request.
```

It should also function with OpenOrca and Platypus prompt formats.