Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- Squish42/bluemoon-fandom-1-1-rp-cleaned
|
4 |
+
- OpenLeecher/Teatime
|
5 |
+
- PygmalionAI/PIPPA
|
6 |
+
tags:
|
7 |
+
- not-for-all-audiences
|
8 |
+
- nsfw
|
9 |
+
license: cc-by-nc-4.0
|
10 |
+
---
|
11 |
+
## What is PetrolLM-Claude-Chat?
|
12 |
+
PetrolLM-Claude-Chat is the [CollectiveCognition-v1.1-Mistral-7B](https://huggingface.co/teknium/CollectiveCognition-v1.1-Mistral-7B) model with the [PetrolLoRA](https://huggingface.co/Norquinal/PetrolLoRA) applied.
|
13 |
+
|
14 |
+
The dataset (for the LoRA) consists of 2800 samples, with the composition as follows:
|
15 |
+
* AICG Logs (~34%)
|
16 |
+
* PygmalionAI/PIPPA (~33%)
|
17 |
+
* Squish42/bluemoon-fandom-1-1-rp-cleaned (~29%)
|
18 |
+
* OpenLeecher/Teatime (~4%)
|
19 |
+
|
20 |
+
These samples were then back-filled using gpt-4/gpt-3.5-turbo-16k or otherwise converted to fit the prompt format.
|
21 |
+
|
22 |
+
## Prompt Format
|
23 |
+
The model uses the following prompt format:
|
24 |
+
```
|
25 |
+
---
|
26 |
+
style: roleplay
|
27 |
+
characters:
|
28 |
+
[char]: [description]
|
29 |
+
summary: [scenario]
|
30 |
+
---
|
31 |
+
<chat_history>
|
32 |
+
Format:
|
33 |
+
[char]: [message]
|
34 |
+
Human: [message]
|
35 |
+
```
|
36 |
+
|
37 |
+
## Use in Text Generation Web UI
|
38 |
+
Install the bleeding-edge version of `transformers` from source:
|
39 |
+
```
|
40 |
+
pip install git+https://github.com/huggingface/transformers
|
41 |
+
```
|
42 |
+
Or, alternatively, change `model_type` in `config.json` from `mistral` to `llama`.
|
43 |
+
|
44 |
+
## Use in SillyTavern UI
|
45 |
+
![](https://files.catbox.moe/2dkr28.png)
|
46 |
+
As an addendum, you can include one of the following as the `Last Output Sequence`:
|
47 |
+
```
|
48 |
+
Human: In your next reply, write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.
|
49 |
+
{{char}}:
|
50 |
+
```
|
51 |
+
```
|
52 |
+
{{char}} (2 paragraphs, engaging, natural, authentic, descriptive, creative):
|
53 |
+
```
|
54 |
+
```
|
55 |
+
[System note: Write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.]
|
56 |
+
{{char}}:
|
57 |
+
```
|
58 |
+
The third one seems to work the best. I would recommend experimenting with creating your own to best suit your needs.
|