squad_natural_question_oqpl / tokenizer_config.json
system's picture
system HF staff
Update tokenizer_config.json
4a37cb9
raw
history blame
126 Bytes
{"max_len": 1024, "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>", "init_inputs": []}