Kirundi-English MT5 Translator with LoRA
This is a LoRA-fine-tuned version of mT5-small for Kirundi-English translation.
Model Details
- Base Model: google/mt5-small
- LoRA rank: 8
- LoRA alpha: 32
- Target modules: q, v
- Training Data: {len(tokenized_dataset["train"])} examples
- Validation Data: {len(tokenized_dataset["test"])} examples
Training Parameters
- Learning Rate: 2e-5
- Batch Size: 8
- Epochs: 3
- Weight Decay: 0.01
Current Metrics
- BLEU Score: 0.000054
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.