ludis commited on
Commit
a24d144
1 Parent(s): f52fdfa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -10
README.md CHANGED
@@ -4,11 +4,9 @@ datasets:
4
  - lemonilia/LimaRP
5
  ---
6
 
7
- ## GPTQ
8
 
9
- 2048 sequence length
10
-
11
- VMware/open-instruct dataset
12
 
13
  ## Training
14
 
@@ -24,9 +22,3 @@ base model mistralai/Mixtral-8x7B-v0.1 tuned on koishi commit 6e675d1 for one ep
24
  then tuned on pippa 6412b0c for one epoch (metharme completion)
25
 
26
  then tuned on limarp Version 2023-10-19 for 2 epochs in metharme completion format with limit_data_length set to 32768 in dataprepare-templates.py
27
-
28
- ## Prompting
29
-
30
- The current model version has been trained on prompts using three different roles, which are denoted by the following tokens: `<|system|>`, `<|user|>` and `<|model|>`.
31
-
32
- The `<|system|>` prompt can be used to inject out-of-channel information behind the scenes, while the `<|user|>` prompt should be used to indicate user input. The `<|model|>` token should then be used to indicate that the model should generate a response. These tokens can happen multiple times and be chained up to form a conversation history.
 
4
  - lemonilia/LimaRP
5
  ---
6
 
7
+ ## Gen Settings & Prompting
8
 
9
+ https://rentry.org/tsukasamodel
 
 
10
 
11
  ## Training
12
 
 
22
  then tuned on pippa 6412b0c for one epoch (metharme completion)
23
 
24
  then tuned on limarp Version 2023-10-19 for 2 epochs in metharme completion format with limit_data_length set to 32768 in dataprepare-templates.py