Qwen
/

Qwen-7B-Chat

Text Generation

Model card Files Files and versions Community

Qwen-7B-Chat / tokenization_qwen.py

Commit History

update tokenization and readme

acdaf68

yangapku commited on Aug 8, 2023

refactor tokenization and update readme

69bd8ac

yangapku commited on Aug 5, 2023

revert convert_tokens_to_string

f2e5005

yangapku commited on Aug 4, 2023

update readme and fix convert_tokens_to_string

53c9efa

yangapku commited on Aug 4, 2023

fix decoder, and provide an option to remove attack rejection (#8)

f6498e5

JustinLin610 commited on Aug 4, 2023

update fast usage

f59a0a9

yangapku commited on Aug 3, 2023

implement _convert_id_to_token

10173d4

yangapku commited on Aug 3, 2023

update tokenization_qwen.py

3f9f12c

yangapku commited on Aug 3, 2023

update tokenization_qwen.py

9882935

yangapku commited on Aug 3, 2023

add resource files

4658aaa

yangapku commited on Aug 3, 2023