kobart-trans-jeju-v2 / tokenizer_config.json
rippertnt's picture
add tokenizer
ecaf7df
{
"name_or_path": "gogamza/kobart-base-v2",
"special_tokens_map_file": "/home/circulus/.cache/huggingface/transformers/a87d2ed77831bb40ce806a97c04126addf5ecc82b3e23ecf916b2a4acdb9c29a.c23d5e62137984cf842a885705037b25b156747d145406702932d5f5d5e7c88e",
"tokenizer_class": "PreTrainedTokenizerFast"
}