xgen-7b-8k-inst / tokenization_xgen.py

Commit History

add pad token and default eos token (#7)
76a8dd5

rooa tianxie-sf commited on

.
b2d761b

rooa commited on