Transformers
English

Model Card for omarmomen/ptb_bpe_tokenizer_10k

This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).

"omarmomen/ptb_bpe_tokenizer_10k" is a RobertaTokenizer pretrained on the Penn Tree Bank Training dataset (cased) with 10K tokens.

https://arxiv.org/abs/2403.09714

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train omarmomen/ptb_bpe_tokenizer_10k