thefrigidliquidation's picture
Add model
ea067a3
metadata
language: en
inference: false
tags:
  - text-generation
  - opt
license: other
commercial: false

OPT-1.3B fine-tuned on officially translated light novels.

Fine-tuned OPT-1.3b on 2,500 light novel volumes (~825MB of text).

Epoch Test Loss Train Loss
0 (Not fine-tuned) 4.9080 N/A
1 2.1659 2.0625
2 2.0758 1.8504
3 2.0222 1.7778
4 1.9780 1.5146
5 1.9463 1.5302