As R&D Team at Loodos, we release cased and uncased versions of most recent language models for Turkish. More details about pretrained models and evaluations on downstream tasks can be found here (our repo).
This is ELECTRA-Small model's discriminator which has 12 encoder layers with 256 hidden layers size trained on cased Turkish dataset.
Using AutoModelWithLMHead and AutoTokenizer from Transformers, you can import the model as described below.
from transformers import AutoModel, AutoModelWithLMHead tokenizer = AutoTokenizer.from_pretrained("loodos/electra-small-turkish-cased-discriminator") model = AutoModelWithLMHead.from_pretrained("loodos/electra-small-turkish-cased-discriminator")
You contact us to ask a question, open an issue or give feedback via our github repo.
Many thanks to TFRC Team for providing us cloud TPUs on Tensorflow Research Cloud to train our models.
- Downloads last month
Unable to determine this model’s pipeline type. Check the docs .