# GPT2-Tamil

This repository is created as part of the Flax/Jax community week by Huggingface. The aim of this project is to pre-train a language model using GPT-2 specifically for Tamil language.

## Setup [Todo]:
 
## Dataset Used [Todo]:

## Preprocess Data [Todo]:

## Train (Flax) [Todo]:

## Demo [Todo]: