Hugging Face Space: antonyrajesh/Antony-Tamil-Tokenizer
Author: antonyrajesh
SDK: docker
title: Antony Tamil Tokenizer
short_description: This is a Byte Pair Encoding (BPE) tokenizer for Tamil.