File size: 661 Bytes
347676c ea067a3 347676c ea067a3 347676c 0a51332 ea067a3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
language: en
inference: false
tags:
- text-generation
- opt
license: other
commercial: false
---
# OPT-1.3B fine-tuned on officially translated light novels.
Fine-tuned [OPT-1.3b](https://huggingface.co/facebook/opt-1.3b) on 2,500 light novel volumes (~825MB of text).
| Epoch | Test Loss | Train Loss |
|--------------------|-----------|------------|
| 0 (Not fine-tuned) | 4.9080 | N/A |
| 1 | 2.1659 | 2.0625 |
| 2 | 2.0758 | 1.8504 |
| 3 | 2.0222 | 1.7778 |
| 4 | 1.9780 | 1.5146 |
| 5 | 1.9463 | 1.5302 |
|