heziyevv/aze-bert-tokenizer-middle

Model Details

Model Description

• Developed by: Farid Haziyev
• Model type: Tokenizer
• Language(s) (NLP): Azerbaijani
• License: MIT
• Finetuned from model [optional]: bert-based-uncased

Uses

Can be used in any project intended for the purpose of improving Azerbaijani language models

How to Get Started with the Model

Use the code below to get started with the model.

from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("heziyevv/aze-bert-tokenizer-middle")