byt5-base-fon-fr-mt is a machine translation model from Fon to French based on a fine-tuned google/byt5-base model. It establishes a strong baseline for automatically translating texts from Fon to French.
This model is limited by its training dataset. This may not generalize well for all use cases in different domains.
Specifically, this model is a byt5-base model that was fine-tuned on JW300 Fon corpus and LAFAND. The model was trained using Swahili(sw_KE) as the language since the pre-trained model does not initially support Fon. Thus, you need to use the sw_KE for language code when evaluating the model.
This model was trained on NVIDIA V100 GPU
Fine-tuning byt5-base achieves 5.15 BLEU on LAFAND test set
By David Adelani
- Downloads last month