internlm2-chat-7b / tokenization_internlm2_fast.py

Commit History

fix no white space when using stream_chat with fast tokenizer
4275caa

x54-729 commited on

update model weights
aa1fc6c

ZwwWayne commited on

Fix no white space when using stream_chat with fast tokenizer (#9)
5b50661
verified

RangiLyu x54-729 commited on