---
language: en
inference: false
tags:
- text-generation
- opt

license: other
commercial: false
---

# OPT-1.3B fine-tuned on officially translated light novels.

Fine-tuned [OPT-1.3b](https://huggingface.co/facebook/opt-1.3b) on 2,500 light novel volumes (~825MB of text).

| Epoch              | Test Loss | Train Loss |
|--------------------|-----------|------------|
| 0 (Not fine-tuned) | 4.9080    | N/A        |
| 1                  | 2.1659    | 2.0625     |
| 2                  | 2.0758    | 1.8504     |
| 3                  | 2.0222    | 1.7778     |
| 4                  | 1.9780    | 1.5146     |
| 5                  | 1.9463    | 1.5302     |