make sp_model init before __init__ to compat with transformer>=4.34
#2
by
ariwaranosai
- opened
AttributeError: 'BaichuanTokenizer' object has no attribute 'sp_model' will be raised if sp_model would be set properly, since PreTrainedTokenizer' init func will call _add_tokens which need get_vocab.
这个pr还没通过？？Baichuan彻底摆烂了？
GradientGuru
changed pull request status to
merged