metadata
license: mit
language:
- az
tags:
- wikipedia
- books
- social-media
vocab-size: 16378
Model Details
Model Description
- Developed by: Farid Haziyev
- Model type: Tokenizer
- Language(s) (NLP): Azerbaijani
- License: MIT
- Finetuned from model [optional]: bert-based-uncased
Uses
Can be used in any project intended for the purpose of improving Azerbaijani language models
How to Get Started with the Model
Use the code below to get started with the model.
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("heziyevv/aze-bert-tokenizer-middle")