# English to Luo

Author: Kathleen Siminyu

## Data

	- The JW300 English-Luo dataset, 154941 lines.

## Model
  
	- Link to google drive folder with model(https://drive.google.com/drive/folders/1_q4Gj4cIAbhNxTU3XOa1OH9Sxtg2cvEM?usp=sharing)

## Analysis
	- Tried out different BPE settings and managed some improvements on the baseline. Highest BLEU score I recorded was at BPE 30000. It might be worth exploring different bpe settings for the source 		and target languages. Results from different settings included in the analysis below.

BPE 4000
```sh
	BLEU dev: 23.22
	BLEU test: 32.64
```

BPE 5000
```sh
	2020-05-17 17:50:01,865 -  dev bleu:  23.32 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 17:51:18,137 - test bleu:  32.52 [Beam search decoding with beam size = 5 and alpha = 1.0]
```

BPE 10000
```sh
	2020-05-17 17:52:12,396 -  dev bleu:  24.26 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 17:53:26,893 - test bleu:  32.97 [Beam search decoding with beam size = 5 and alpha = 1.0]
```

BPE 15000
```sh
	2020-05-17 17:54:28,069 -  dev bleu:  24.55 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 17:55:46,813 - test bleu:  33.43 [Beam search decoding with beam size = 5 and alpha = 1.0]
```
BPE 20000
```sh
	2020-05-17 18:01:41,447 -  dev bleu:  25.34 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 18:03:03,470 - test bleu:  33.38 [Beam search decoding with beam size = 5 and alpha = 1.0]
```
BPE 25000
```sh
	2020-05-17 18:09:26,069 -  dev bleu:  24.81 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 18:10:45,675 - test bleu:  33.68 [Beam search decoding with beam size = 5 and alpha = 1.0]
```
BPE 35000
```sh
	2020-05-17 20:35:45,530 -  dev bleu:  25.08 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 20:36:23,282 - test bleu:  33.70 [Beam search decoding with beam size = 5 and alpha = 1.0]
```
BPE 40000
```sh
	2020-05-17 20:43:32,542 -  dev bleu:  24.75 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 20:44:11,245 - test bleu:  33.58 [Beam search decoding with beam size = 5 and alpha = 1.0]
```

# Results
BPE 30000
```
	2020-05-17 20:28:46,395 -  dev bleu:  25.24 [Beam search decoding with beam size = 5 and alpha = 1.0]
	2020-05-17 20:29:20,937 - test bleu:  34.33 [Beam search decoding with beam size = 5 and alpha = 1.0]
```