|
--- |
|
language: en |
|
inference: false |
|
tags: |
|
- text-generation |
|
- opt |
|
|
|
license: other |
|
commercial: false |
|
--- |
|
|
|
# OPT-1.3B fine-tuned on officially translated light novels. |
|
|
|
Fine-tuned [OPT-1.3b](https://huggingface.co/facebook/opt-1.3b) on 2,500 light novel volumes (~825MB of text). |
|
|
|
| Epoch | Test Loss | Train Loss | |
|
|--------------------|-----------|------------| |
|
| 0 (Not fine-tuned) | 4.9080 | N/A | |
|
| 1 | 2.1659 | 2.0625 | |
|
| 2 | 2.0758 | 1.8504 | |
|
| 3 | 2.0222 | 1.7778 | |
|
| 4 | 1.9780 | 1.5146 | |
|
| 5 | 1.9463 | 1.5302 | |
|
|
