javi8979 commited on
Commit
c44f1ec
·
verified ·
1 Parent(s): c2371e6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -2
README.md CHANGED
@@ -463,6 +463,21 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
463
 
464
  ### Low-Resource Languages of Spain
465
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
466
  #### Spanish-XX
467
 
468
  | | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
@@ -470,7 +485,7 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
470
  | SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
471
  | SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
472
  | salamandraTA2B | es | ast | 16.68 | 77.29 | 49.46 |
473
- | nllb_3.3B | es | ast | 11.85 | 100.86 | 40.27 |
474
  | | | | | | |
475
  | SalamandraTA-7b-base | es | arn | **29.19** | **71.85** | **49.42** |
476
  | SalamandraTA-7b-instruct | es | arn | 26.82 | 74.04 | 47.55 |
@@ -489,7 +504,7 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
489
  | SalamandraTA-7b-instruct | ca | ast | **27.86** | **58.19** | 57.98 |
490
  | SalamandraTA-7b-base | ca | ast | 26.11 | 63.63 | **58.08** |
491
  | salamandraTA2B | ca | ast | 25.32 | 62.59 | 55.98 |
492
- | nllb_3.3B | ca | ast | 17.17 | 91.47 | 45.83 |
493
  | | | | | | |
494
  | SalamandraTA-7b-base | ca | arn | **17.77** | **80.88** | **42.12** |
495
  | SalamandraTA-7b-instruct | ca | arn | 16.45 | 82.01 | 41.04 |
@@ -500,6 +515,7 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
500
  | salamandraTA2B | ca | arg | 18.6 | 65.82 | 51.21 |
501
 
502
 
 
503
  ## Ethical Considerations and Limitations
504
 
505
  Detailed information on the work done to examine the presence of unwanted social and cognitive biases in the base model can be found
 
463
 
464
  ### Low-Resource Languages of Spain
465
 
466
+ #### English-XX
467
+
468
+ | | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
469
+ |:---------------------------------|:---------|:---------|-------:|-------:|-------:|
470
+ | SalamandraTA-7b-instruct | en | ast | **31.49** | **54.01** | **60.65** |
471
+ | SalamandraTA-7b-base | en | ast | 26.4 | 64.02 | 57.35 |
472
+ | nllb-3.3B | en | ast | 22.02 | 77.26 | 51.4 |
473
+ | | | | | | |
474
+ | SalamandraTA-7b-instruct | en | arn | **13.04** | **87.13** | **37.56** |
475
+ | SalamandraTA-7b-base | en | arn | 8.36 | 90.85 | 34.06 |
476
+ | | | | | | |
477
+ | SalamandraTA-7b-instruct | en | arg | **20.43** | **65.62** | **50.79** |
478
+ | SalamandraTA-7b-base | en | arg | 12.24 | 73.48 | 44.75 |
479
+
480
+
481
  #### Spanish-XX
482
 
483
  | | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
 
485
  | SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
486
  | SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
487
  | salamandraTA2B | es | ast | 16.68 | 77.29 | 49.46 |
488
+ | nllb-3.3B | es | ast | 11.85 | 100.86 | 40.27 |
489
  | | | | | | |
490
  | SalamandraTA-7b-base | es | arn | **29.19** | **71.85** | **49.42** |
491
  | SalamandraTA-7b-instruct | es | arn | 26.82 | 74.04 | 47.55 |
 
504
  | SalamandraTA-7b-instruct | ca | ast | **27.86** | **58.19** | 57.98 |
505
  | SalamandraTA-7b-base | ca | ast | 26.11 | 63.63 | **58.08** |
506
  | salamandraTA2B | ca | ast | 25.32 | 62.59 | 55.98 |
507
+ | nllb-3.3B | ca | ast | 17.17 | 91.47 | 45.83 |
508
  | | | | | | |
509
  | SalamandraTA-7b-base | ca | arn | **17.77** | **80.88** | **42.12** |
510
  | SalamandraTA-7b-instruct | ca | arn | 16.45 | 82.01 | 41.04 |
 
515
  | salamandraTA2B | ca | arg | 18.6 | 65.82 | 51.21 |
516
 
517
 
518
+
519
  ## Ethical Considerations and Limitations
520
 
521
  Detailed information on the work done to examine the presence of unwanted social and cognitive biases in the base model can be found