pere
/

roberta-base-exp-8

Fill-Mask Transformers PyTorch JAX TensorBoard 9 languages xlm-roberta norwegian bert Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

roberta-base-exp-8 / copy_tokenizer_config.py

pere's picture

Original

fdae827 over 1 year ago

raw history blame contribute delete

No virus

312 Bytes

	# Code used for copying tokenizer and config

	from transformers import XLMRobertaTokenizerFast, XLMRobertaConfig

	tokenizer = XLMRobertaTokenizerFast.from_pretrained("xlm-roberta-base")
	config = XLMRobertaConfig.from_pretrained("xlm-roberta-base")

	tokenizer.save_pretrained("./")
	config.save_pretrained("./")