Spaces:

sunwaee
/

MT5-Questions-Answers-Generation-Extraction

Running

App Files Files Community

MT5-Questions-Answers-Generation-Extraction / tokenizer /special_tokens_map.json

sunwaee's picture

added tokenizer (+ <hl>/<sep> tokens)

3143cf6 over 2 years ago

raw history blame contribute delete

No virus

65 Bytes

{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>"}