quan26 commited on
Commit
da84998
1 Parent(s): 2fb0db1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -21
README.md CHANGED
@@ -4,29 +4,21 @@ base_model: udkai/Turdus
4
  ---
5
 
6
  # Model Card for Model ID
7
-
8
- prompt格式如下:
9
- ```python
10
- system_prompt = '''You are now roleplaying as {Character Nickname}.
11
- {character_msg}
12
- Identity: Nurse
13
- Categories: Erotica, Please use an {tone} tone
14
- Personalities: {personalities}
15
- ```
16
-
17
  推理配置需要注意的几个参数:
18
  ```
19
- 'temperature': 0.85
20
- 'top_p': 0.95, # disable
21
- 'top_k': 20, # disable
22
- 'repetition_penalty': 1.18,
23
- 'max_tokens': 120,
24
- 'stop': ["\n", "\u200d"],
25
- 'typical_p': 0.95,
26
- 'n': 1,
 
 
27
  ```
28
 
29
- Prompt Template for alpaca style
30
  ```
31
  ### Instruction:
32
 
@@ -34,6 +26,35 @@ Prompt Template for alpaca style
34
 
35
  ### Response:
36
  ```
37
- 训练参数:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
  ```
39
- ```
 
4
  ---
5
 
6
  # Model Card for Model ID
 
 
 
 
 
 
 
 
 
 
7
  推理配置需要注意的几个参数:
8
  ```
9
+ params = {
10
+ 'temperature': 0.85,
11
+ 'top_p': 0.95,
12
+ 'top_k': 20,
13
+ 'repetition_penalty': 1.18,
14
+ 'max_tokens': 120,
15
+ 'stop': ["\n", "\u200d"],
16
+ 'typical_p': 0.95,
17
+ 'n': 1,
18
+ }
19
  ```
20
 
21
+ Prompt模板格式
22
  ```
23
  ### Instruction:
24
 
 
26
 
27
  ### Response:
28
  ```
29
+
30
+ 训练参数(使用Llama-Factory训练):
31
+ ```
32
+ - learning_rate: 5e-05
33
+ - lr_scheduler_type: cosine
34
+ - per_device_train_batch_size: 1
35
+ - per_device_eval_batch_size: 1
36
+ - gradient_accumulation_steps: 4
37
+ - warmup_steps: 24
38
+ - num_train_epochs: 2
39
+ - template: alpaca
40
+ - cutoff_len: 2048
41
+ - finetuning_type: lora
42
+ - lora_target: q_proj,v_proj,o_proj,k_proj
43
+ - quantization_bit: 8
44
+ - lora_rank: 64
45
+ - lora_alpha: 16
46
+ - bf16: True
47
+ - logging_steps: 20
48
+ - val_size: 4
49
+ - save_steps: 200
50
+ ```
51
+
52
+ 训练prompt格式如下:
53
+ ```python
54
+ system_prompt = '''You are now roleplaying as {Character Nickname}.
55
+ {character_msg}
56
+ Identity: Nurse
57
+ Categories: Erotica, Please use an {tone} tone
58
+ Personalities: {personalities}
59
  ```
60
+