base_model:
- facebook/bart-large
pipeline_tag: translation
library_name: transformers
tags:
- code
Hindi to Bengali Translation using BART
Overview
This project fine-tunes the BART model for Hindi-to-Bengali translation using the Hind-Beng-5k dataset. The model is trained using the Hugging Face transformers library with PyTorch.
Dataset
We use the Hind-Beng-5k dataset from Hugging Face, which contains parallel Hindi and Bengali text samples. Dataset: sudeshna84/Hind-Beng-5k
Model
The model used for translation is facebook/bart-large. It is fine-tuned for sequence-to-sequence translation from Hindi to Bengali using the BART architecture.
Installation To run the project, install the required dependencies: pip install transformers datasets torch
Preprocessing The dataset is preprocessed by tokenizing the Hindi input text and Bengali target text using the BART tokenizer.
Training The model is trained using the Trainer API from Hugging Face with the following parameters: Batch size: 8 Learning rate: 2e-5 Epochs: 3 Weight decay: 0.01
Credits Tag Sudeshna Sani- https://huggingface.co/sudeshna84