PEFT
meta-llama
code
instruct
WizardLM
Zangs3011 commited on
Commit
1b098de
1 Parent(s): d18a476

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -1,19 +1,19 @@
1
  ---
2
  library_name: peft
3
  tags:
4
- - gptj
5
  - code
6
  - instruct
7
  - WizardLM
8
  datasets:
9
  - WizardLM/WizardLM_evol_instruct_70k
10
- base_model: EleutherAI/gpt-j-6b
11
  license: apache-2.0
12
  ---
13
 
14
  ### Finetuning Overview:
15
 
16
- **Model Used:** EleutherAI/gpt-j-6b
17
  **Dataset:** WizardLM/WizardLM_evol_instruct_70k
18
 
19
  #### Dataset Insights:
@@ -30,19 +30,19 @@ With the utilization of [MonsterAPI](https://monsterapi.ai)'s [LLM finetuner](ht
30
  #### Hyperparameters & Additional Details:
31
 
32
  - **Epochs:** 1
33
- - **Model Path:** EleutherAI/gpt-j-6b
34
  - **Learning Rate:** 0.0002
35
  - **Data Split:** 90% train 10% validation
36
  - **Gradient Accumulation Steps:** 4
37
 
38
- ---
39
 
40
  ### INSTRUCTION:
41
  [instruction]
42
 
43
  ### RESPONSE:
44
  [output]
45
-
46
  Training loss :
47
  ![training loss](train-loss.png "Training loss")
48
 
 
1
  ---
2
  library_name: peft
3
  tags:
4
+ - meta-llama
5
  - code
6
  - instruct
7
  - WizardLM
8
  datasets:
9
  - WizardLM/WizardLM_evol_instruct_70k
10
+ base_model: meta-llama/Llama-2-7b-hf
11
  license: apache-2.0
12
  ---
13
 
14
  ### Finetuning Overview:
15
 
16
+ **Model Used:** meta-llama/Llama-2-7b-hf
17
  **Dataset:** WizardLM/WizardLM_evol_instruct_70k
18
 
19
  #### Dataset Insights:
 
30
  #### Hyperparameters & Additional Details:
31
 
32
  - **Epochs:** 1
33
+ - **Model Path:** meta-llama/Llama-2-7b-hf
34
  - **Learning Rate:** 0.0002
35
  - **Data Split:** 90% train 10% validation
36
  - **Gradient Accumulation Steps:** 4
37
 
38
+ ```
39
 
40
  ### INSTRUCTION:
41
  [instruction]
42
 
43
  ### RESPONSE:
44
  [output]
45
+ ```
46
  Training loss :
47
  ![training loss](train-loss.png "Training loss")
48