File size: 345 Bytes
775fe54 4005a71 775fe54 4005a71 775fe54 4005a71 775fe54 4005a71 775fe54 4005a71 775fe54 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
library_name: transformers
tags: []
---
# Model Card for Model ID
- Summary Length PPO experiment #2
- No KL divergence in loss
## Model Details
- Dataset size: 1024
- Epochs: 2
- Batch Size: 4 * 8 (w / Gradient Accumulation)
Optimizer args: Torch AdamW default, except
- LR = 0.0001
## Outcomes
Only outputs one word "relationship"
|