File size: 534 Bytes
620ec74
 
 
6df9c4f
620ec74
 
 
7bba37d
6df9c4f
 
620ec74
 
6df9c4f
620ec74
6df9c4f
620ec74
246a27b
d8f69d6
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
---
language:
- en
- ja
license: apache-2.0
tags:
- llama
base_model: NilanE/tinyllama-relora-merge
datasets:
- NilanE/ParallelFiction-Ja_En-100k
---

Trained for 2 epochs on NilanE/ParallelFiction-Ja_En-100k using QLoRA. CPO tune is in-progress. 

Input should be 500-1000 tokens long. Make sure to set 'do_sample = False' if using HF transformers for inference, or otherwise set temperature to 0 for deterministic outputs.

## Prompt format:
```
Translate this from Japanese to English:
### JAPANESE:
{source_text}
### ENGLISH:

```