dhuck
/

synthesis-synthesis

Text Generation

Inference Endpoints

Model card Files Files and versions Community

synthesis-synthesis / tokenizer_config.json

dhuck's picture

Upload tokenizer

eb38850 about 1 year ago

raw history blame contribute delete

No virus

226 Bytes

	{
	"bos_token": "<\|endoftext\|>",
	"model_max_length": 2048,
	"name_or_path": "facebook/incoder-1B",
	"special_tokens_map_file": "tokenizer/v2_trfs/special_tokens_map.json",
	"tokenizer_class": "PreTrainedTokenizerFast"
	}