File size: 535 Bytes
620ec74
 
 
6df9c4f
620ec74
 
 
7bba37d
6df9c4f
 
620ec74
 
6df9c4f
620ec74
6df9c4f
620ec74
6df9c4f
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
---
language:
- en
- ja
license: apache-2.0
tags:
- llama
base_model: NilanE/tinyllama-relora-merge
datasets:
- NilanE/ParallelFiction-Ja_En-100k
---

Trained for 2 epochs on NilanE/ParallelFiction-Ja_En-100k using QLoRA. CPO tune is in-progress. 

Input should be 500-1000 tokens long. Make sure to set 'do_sample = False' if using HF transformers for inference, or otherwise set temperature to 0 for deterministic outputs.

## Prompt format
"""Translate this from Japanese to English:\n### JAPANESE:\n{source_text}\n### ENGLISH:\n"""