gpt2-TOD_finetuned_SGD / added_tokens.json
armandnlp's picture
add tokenizer
3087415
raw
history blame contribute delete
328 Bytes
{"<|belief|>": 50257, "<|endofaction|>": 50260, "<|system|>": 50266, "<|endofbelief|>": 50258, "<|task|>": 50267, "<|endofchitchat|>": 50270, "<|response|>": 50261, "<|chitchat|>": 50269, "<|user|>": 50265, "<|action|>": 50259, "<|endoftask|>": 50268, "<|context|>": 50263, "<|endofcontext|>": 50264, "<|endofresponse|>": 50262}