ludis commited on
Commit
8426670
1 Parent(s): e730bed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -6
README.md CHANGED
@@ -4,6 +4,10 @@ datasets:
4
  - lemonilia/LimaRP
5
  ---
6
 
 
 
 
 
7
  ## GPTQ
8
 
9
  2048 sequence length
@@ -24,9 +28,3 @@ base model mistralai/Mixtral-8x7B-v0.1 tuned on koishi commit 6e675d1 for one ep
24
  then tuned on pippa 6412b0c for one epoch (metharme completion)
25
 
26
  then tuned on limarp Version 2023-10-19 for 2 epochs in metharme completion format with limit_data_length set to 32768 in dataprepare-templates.py
27
-
28
- ## Prompting
29
-
30
- The current model version has been trained on prompts using three different roles, which are denoted by the following tokens: `<|system|>`, `<|user|>` and `<|model|>`.
31
-
32
- The `<|system|>` prompt can be used to inject out-of-channel information behind the scenes, while the `<|user|>` prompt should be used to indicate user input. The `<|model|>` token should then be used to indicate that the model should generate a response. These tokens can happen multiple times and be chained up to form a conversation history.
 
4
  - lemonilia/LimaRP
5
  ---
6
 
7
+ ## Gen Settings & Prompting
8
+
9
+ https://rentry.org/tsukasamodel
10
+
11
  ## GPTQ
12
 
13
  2048 sequence length
 
28
  then tuned on pippa 6412b0c for one epoch (metharme completion)
29
 
30
  then tuned on limarp Version 2023-10-19 for 2 epochs in metharme completion format with limit_data_length set to 32768 in dataprepare-templates.py