Update README.md
Browse files
README.md
CHANGED
|
@@ -49,7 +49,7 @@ The model was trained on a dataset specifically designed for the mortgage and lo
|
|
| 49 |
### Hyperparameters
|
| 50 |
|
| 51 |
- **Optimizer**: AdamW
|
| 52 |
-
- **Learning Rate**: 0.0002
|
| 53 |
- **Epochs**: 4
|
| 54 |
- **Batch Size**: 10
|
| 55 |
- **Gradient Accumulation Steps**: 8
|
|
|
|
| 49 |
### Hyperparameters
|
| 50 |
|
| 51 |
- **Optimizer**: AdamW
|
| 52 |
+
- **Learning Rate**: 0.0002 with a cosine learning rate scheduler
|
| 53 |
- **Epochs**: 4
|
| 54 |
- **Batch Size**: 10
|
| 55 |
- **Gradient Accumulation Steps**: 8
|