chatglm-6b / tokenization_chatglm.py

Commit History

Add gmask token id
36b7f2d

zxdu20 commited on

Update code for slim
63ce1ba

zxdu20 commited on

Drop icetk dependency
72985e8

zxdu20 commited on

Fix decode method for torch tensor
23ad39b

zxdu20 commited on

Support single integer or empty list as input to decode (#7)
fdb7a60

zxdu20 peakji commited on

Fix generate
fb23542

zxdu20 commited on

Fix attention_mask and position_ids
373fd6b

zxdu20 commited on

Fix encode method
e22cddf

zxdu20 commited on

Fix batch input
e1494f2

zxdu20 commited on

Implement batch generation
cc96a22

zxdu20 commited on

Change padding side
db22499

zxdu20 commited on

Fix typo in tokenization_chatglm.py
1b54948

songxxzp commited on

Remove image tokens when decoding
8492687

zxdu20 commited on

Update tokenizer
c4575e7

zxdu20 commited on

Add chatglm-6b
d11c6aa

Sengxian commited on