nornor02
/

CustomTokenizer

Generated from Trainer

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

CustomTokenizer / special_tokens_map.json

nornor02's picture

Training in progress, step 500

bf730c6 10 months ago

100 Bytes

{"unk_token":"<unk>","sep_token":"</s>","pad_token":"<pad>","cls_token":"<s>","mask_token":"<mask>"}