arunapriyad24/MT

Hindi to Bengali Translation using BART

Overview

This project fine-tunes the BART model for Hindi-to-Bengali translation using the Hind-Beng-5k dataset. The model is trained using the Hugging Face transformers library with PyTorch.

Dataset

We use the Hind-Beng-5k dataset from Hugging Face, which contains parallel Hindi and Bengali text samples. Dataset: sudeshna84/Hind-Beng-5k

Model

The model used for translation is facebook/bart-large. It is fine-tuned for sequence-to-sequence translation from Hindi to Bengali using the BART architecture.

Installation To run the project, install the required dependencies: pip install transformers datasets torch

Preprocessing The dataset is preprocessed by tokenizing the Hindi input text and Bengali target text using the BART tokenizer.

Training The model is trained using the Trainer API from Hugging Face with the following parameters: Batch size: 8 Learning rate: 2e-5 Epochs: 3 Weight decay: 0.01

Credits Tag Sudeshna Sani- https://huggingface.co/sudeshna84