Edit model card

xlnet-base-bahasa-cased

Pretrained XLNET base language model for Malay.

Pretraining Corpus

xlnet-base-bahasa-cased model was pretrained on ~1.4 Billion words. Below is list of data we trained on,

  1. cleaned local texts.
  2. translated The Pile.

Pretraining details

Load Pretrained Model

You can use this model by installing torch or tensorflow and Huggingface library transformers. And you can use it directly by initializing it like this:

from transformers import XLNetModel, XLNetTokenizer

model = XLNetModel.from_pretrained('malay-huggingface/xlnet-base-bahasa-cased')
tokenizer = XLNetTokenizer.from_pretrained(
    'malay-huggingface/xlnet-base-bahasa-cased',
    do_lower_case = False,
)
Downloads last month
7
Hosted inference API

Unable to determine this model’s pipeline type. Check the docs .