practicaldreamer commited on
Commit
a9e2886
1 Parent(s): 354d7e5

Updated with further descriptions

Browse files
Files changed (1) hide show
  1. README.md +37 -2
README.md CHANGED
@@ -2,7 +2,35 @@
2
  datasets:
3
  - practicaldreamer/RPGPT_PublicDomain-ShareGPT
4
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ## Expected Prompt Format
 
6
  ```
7
  A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.
8
 
@@ -17,7 +45,10 @@ USER: Write a character roleplay dialogue using asterisk roleplay format based o
17
  ## Scenario:
18
  <Scenario Description>
19
 
20
- ASSISTANT:
 
 
 
21
  <User-Character Name>: \*<1st person action/sensations/thoughts>\* <Spoken Word> \*<1st person action/sensations/thoughts>\*
22
  <Bot-Character Name>: \*<1st person action/sensations/thoughts>\* <Spoken Word> \*<1st person action/sensations/thoughts>\*
23
  <User-Character Name>: \*<1st person action/sensations/thoughts>\* <Spoken Word> \*<1st person action/sensations/thoughts>\*
@@ -25,7 +56,7 @@ ASSISTANT:
25
  ...
26
  ```
27
 
28
- ## Example (User is Baloo from The Jungle Book Bot is Queen of Hearts from Alice in Wonderland)
29
  ```
30
  A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.
31
 
@@ -52,6 +83,10 @@ The Queen of Hearts: *sniffs haughtily and scowls at Baloo* And who are you to p
52
  Baloo: *bows graciously but maintains eye contact* Begging your pardon, Your Majesty. My name is Baloo, and I've heard tales of your... unique temperament.
53
  The Queen of Hearts:
54
  ```
 
 
 
 
55
  ---
56
  license: mit
57
  ---
 
2
  datasets:
3
  - practicaldreamer/RPGPT_PublicDomain-ShareGPT
4
  ---
5
+
6
+ ## Introduction
7
+ This is my first attempt at training a model for long form character interaction using asterisk roleplay format.
8
+ There are plenty of general instruction/answer models but most focus on single responses between an ai and a human.
9
+ My goal for this project is to more closely align the training data with CHARACTER interactions for roleplay.
10
+
11
+ This model is trained on a small synthetic dataset of characters interacting through a variety of scenarios.
12
+ The Characters, Scenarios and interactions were all generated by GPT4.
13
+
14
+ Intended for research, creative writing, entertainment, DnD campaigns? fun!
15
+
16
+ ## Train Summary
17
+ [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
18
+ Duration: ~4hrs
19
+ GPU: 1xA100 80GB
20
+ Epochs: 1.08
21
+ Speed: 3e-5
22
+ Sequence_len: 2048
23
+ gradient_accumulation_steps: 32
24
+ wandb link: https://wandb.ai/practicaldreamer/rpgpt/runs/d4gsi8vy
25
+
26
+ *Please see the documentation folder for more information*
27
+
28
+ ## Usage
29
+ This LoRA was trained for use with **Neko-Institute-of-Science/LLaMA-30B-HF**
30
+ Follow the expected Prompt Format.
31
+
32
  ## Expected Prompt Format
33
+ **Context/Memory**
34
  ```
35
  A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.
36
 
 
45
  ## Scenario:
46
  <Scenario Description>
47
 
48
+ ASSISTANT:
49
+ ```
50
+ **Turn Template**
51
+ ```
52
  <User-Character Name>: \*<1st person action/sensations/thoughts>\* <Spoken Word> \*<1st person action/sensations/thoughts>\*
53
  <Bot-Character Name>: \*<1st person action/sensations/thoughts>\* <Spoken Word> \*<1st person action/sensations/thoughts>\*
54
  <User-Character Name>: \*<1st person action/sensations/thoughts>\* <Spoken Word> \*<1st person action/sensations/thoughts>\*
 
56
  ...
57
  ```
58
 
59
+ ## Example (User is Baloo from The Jungle Book. Bot is Queen of Hearts from Alice in Wonderland)
60
  ```
61
  A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.
62
 
 
83
  Baloo: *bows graciously but maintains eye contact* Begging your pardon, Your Majesty. My name is Baloo, and I've heard tales of your... unique temperament.
84
  The Queen of Hearts:
85
  ```
86
+
87
+ ## Thanks
88
+ openaccess-ai-collective https://huggingface.co/openaccess-ai-collective
89
+
90
  ---
91
  license: mit
92
  ---