centino00 commited on
Commit
f621b53
1 Parent(s): 5128d66

End of training

Browse files
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Helsinki-NLP/opus-mt-ar-en
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - bleu
8
+ model-index:
9
+ - name: darija-latin-to-english-new
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # darija-latin-to-english-new
17
+
18
+ This model is a fine-tuned version of [Helsinki-NLP/opus-mt-ar-en](https://huggingface.co/Helsinki-NLP/opus-mt-ar-en) on the None dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.0635
21
+ - Bleu: 18.3432
22
+ - Gen Len: 9.0506
23
+
24
+ ## Model description
25
+
26
+ More information needed
27
+
28
+ ## Intended uses & limitations
29
+
30
+ More information needed
31
+
32
+ ## Training and evaluation data
33
+
34
+ More information needed
35
+
36
+ ## Training procedure
37
+
38
+ ### Training hyperparameters
39
+
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 2e-05
42
+ - train_batch_size: 32
43
+ - eval_batch_size: 32
44
+ - seed: 42
45
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
+ - lr_scheduler_type: linear
47
+ - num_epochs: 2
48
+ - mixed_precision_training: Native AMP
49
+
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
53
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
54
+ | 0.046 | 0.24 | 500 | 0.0939 | 4.0335 | 11.1293 |
55
+ | 0.0347 | 0.48 | 1000 | 0.0788 | 9.8265 | 10.1861 |
56
+ | 0.0279 | 0.72 | 1500 | 0.0725 | 13.178 | 9.6648 |
57
+ | 0.0251 | 0.96 | 2000 | 0.0684 | 15.8154 | 9.536 |
58
+ | 0.0211 | 1.2 | 2500 | 0.0666 | 17.0063 | 9.3259 |
59
+ | 0.0197 | 1.44 | 3000 | 0.0650 | 17.4465 | 9.2086 |
60
+ | 0.0199 | 1.68 | 3500 | 0.0639 | 18.3809 | 9.0083 |
61
+ | 0.0191 | 1.92 | 4000 | 0.0635 | 18.3432 | 9.0506 |
62
+
63
+
64
+ ### Framework versions
65
+
66
+ - Transformers 4.38.1
67
+ - Pytorch 2.1.2
68
+ - Datasets 2.1.0
69
+ - Tokenizers 0.15.2
generation_config.json ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bad_words_ids": [
3
+ [
4
+ 62833
5
+ ]
6
+ ],
7
+ "bos_token_id": 0,
8
+ "decoder_start_token_id": 62833,
9
+ "eos_token_id": 0,
10
+ "forced_eos_token_id": 0,
11
+ "max_length": 512,
12
+ "num_beams": 4,
13
+ "pad_token_id": 62833,
14
+ "renormalize_logits": true,
15
+ "transformers_version": "4.38.1"
16
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d6c807d1859e8d245aed430ddccca43388aab6fcb31bba1afbe2cd69f2d6069
3
  size 305518408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3055b684d48832001abd7e800f3a7a58444dc788bd4866c9c8ad8faed4486f2
3
  size 305518408
runs/Mar06_12-49-08_3999d85c1ec1/events.out.tfevents.1709729350.3999d85c1ec1.109.5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5379257a66a936fd79e230deb2ece6fdda0eaf7f8afe57ea96eff5189605dc5b
3
- size 10135
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0eabfbb7c15c5e738d857fbbcd9ec1980e5acf3ffd25f1fb3f424717975f9214
3
+ size 10489