Text Generation
Transformers
PyTorch
mistral
Not-For-All-Audiences
nsfw
text-generation-inference
Inference Endpoints
Norquinal commited on
Commit
43ace35
1 Parent(s): 7197d1e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - Squish42/bluemoon-fandom-1-1-rp-cleaned
4
+ - OpenLeecher/Teatime
5
+ - PygmalionAI/PIPPA
6
+ tags:
7
+ - not-for-all-audiences
8
+ - nsfw
9
+ license: cc-by-nc-4.0
10
+ ---
11
+ ## What is PetrolLM-Claude-Chat?
12
+ PetrolLM-Claude-Chat is the [CollectiveCognition-v1.1-Mistral-7B](https://huggingface.co/teknium/CollectiveCognition-v1.1-Mistral-7B) model with the [PetrolLoRA](https://huggingface.co/Norquinal/PetrolLoRA) applied.
13
+
14
+ The dataset (for the LoRA) consists of 2800 samples, with the composition as follows:
15
+ * AICG Logs (~34%)
16
+ * PygmalionAI/PIPPA (~33%)
17
+ * Squish42/bluemoon-fandom-1-1-rp-cleaned (~29%)
18
+ * OpenLeecher/Teatime (~4%)
19
+
20
+ These samples were then back-filled using gpt-4/gpt-3.5-turbo-16k or otherwise converted to fit the prompt format.
21
+
22
+ ## Prompt Format
23
+ The model uses the following prompt format:
24
+ ```
25
+ ---
26
+ style: roleplay
27
+ characters:
28
+ [char]: [description]
29
+ summary: [scenario]
30
+ ---
31
+ <chat_history>
32
+ Format:
33
+ [char]: [message]
34
+ Human: [message]
35
+ ```
36
+
37
+ ## Use in Text Generation Web UI
38
+ Install the bleeding-edge version of `transformers` from source:
39
+ ```
40
+ pip install git+https://github.com/huggingface/transformers
41
+ ```
42
+ Or, alternatively, change `model_type` in `config.json` from `mistral` to `llama`.
43
+
44
+ ## Use in SillyTavern UI
45
+ ![](https://files.catbox.moe/2dkr28.png)
46
+ As an addendum, you can include one of the following as the `Last Output Sequence`:
47
+ ```
48
+ Human: In your next reply, write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.
49
+ {{char}}:
50
+ ```
51
+ ```
52
+ {{char}} (2 paragraphs, engaging, natural, authentic, descriptive, creative):
53
+ ```
54
+ ```
55
+ [System note: Write at least two paragraphs. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment.]
56
+ {{char}}:
57
+ ```
58
+ The third one seems to work the best. I would recommend experimenting with creating your own to best suit your needs.