---
library_name: transformers
tags: []
---

# Model Card for Model ID

- Summary Length PPO experiment #5
- No KL divergence in loss

## Model Details

- Dataset size: 1024
- Epochs: 1
- Batch Size: 4 * 4 (w/ 4 GPUs) * 8 (w/ Gradient Accumulation)

Optimizer args: Torch AdamW default, except
- LR = 0.00001