Commit
•
84cd0c8
1
Parent(s):
1811949
Update README.md
Browse files
README.md
CHANGED
|
@@ -70,17 +70,15 @@ print(result)
|
|
| 70 |
```
|
| 71 |
|
| 72 |
|
| 73 |
-
## Training Details
|
| 74 |
-
|
| 75 |
### Training Data
|
| 76 |
|
| 77 |
- Dataset size: ~75k instruction-response pair.
|
| 78 |
|
| 79 |
-
### Training Procedure
|
| 80 |
|
| 81 |
#### Training Hyperparameters
|
| 82 |
|
| 83 |
- **Epochs:** 1
|
|
|
|
| 84 |
- **Context length:** 1024
|
| 85 |
- **LoRA Rank:** 32
|
| 86 |
- **LoRA Alpha:** 64
|
|
|
|
| 70 |
```
|
| 71 |
|
| 72 |
|
|
|
|
|
|
|
| 73 |
### Training Data
|
| 74 |
|
| 75 |
- Dataset size: ~75k instruction-response pair.
|
| 76 |
|
|
|
|
| 77 |
|
| 78 |
#### Training Hyperparameters
|
| 79 |
|
| 80 |
- **Epochs:** 1
|
| 81 |
+
- **MaxSteps:** 300
|
| 82 |
- **Context length:** 1024
|
| 83 |
- **LoRA Rank:** 32
|
| 84 |
- **LoRA Alpha:** 64
|