| library_name: transformers | |
| tags: [] | |
| # Model Card for Model ID | |
| - Summary Length PPO experiment #2 | |
| - No KL divergence in loss | |
| ## Model Details | |
| - Dataset size: 1024 | |
| - Epochs: 2 | |
| - Batch Size: 4 * 8 (w / Gradient Accumulation) | |
| Optimizer args: Torch AdamW default, except | |
| - LR = 0.0001 | |
| ## Outcomes | |
| Only outputs one word "relationship" | |