读取Tokenizer的时候会出问题 ValueError: Tokenizer class BaiChuanTokenizer does not exist or is not currently imported.
#25
by
mimeme
- opened
如图，读取本地的Tokenizer
Use trust_remote_code=True when loading model and tokenizer. For example,tokenizer = AutoTokenizer.from_pretrained("baichuan-inc/Baichuan-7B", trust_remote_code=True)
如果在没有网络的环境下 有什么办法么
download the repo on your laptop and then upload to the server