Nargizi
/

screeve-pos-lemmatizer

Text2Text Generation

Inference Endpoints

Model card Files Files and versions Community

screeve-pos-lemmatizer / special_tokens_map.json

Nargizi's picture

add tokenizer

c1abbf6 9 months ago

raw history blame contribute delete

No virus

285 Bytes

	{
	"additional_special_tokens": [
	"Cj",
	"V",
	"Num",
	"Pron",
	"N",
	"A",
	"Adv",
	"Other",
	"Interj",
	"Pp",
	"<POS>"
	],
	"cls_token": "<START>",
	"mask_token": "[MASK]",
	"pad_token": "<PAD>",
	"sep_token": "<END>",
	"unk_token": "<UNK>"
	}