baichuan-inc

/

Baichuan2-13B-Chat-4bits

like 86

报错：
OSError: Can't load the configuration of '.models/baichuan-inc_Baichuan2-13B-Chat-4bits/'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure '.models/baichuan-inc_Baichuan2-13B-Chat-4bits/' is the correct path to a directory containing a config.json file

下载模型代码：
snapshot_download(repo_id="baichuan-inc/Baichuan2-13B-Chat-4bits",
local_dir="./baichuan-inc_Baichuan2-13B-Chat-4bits/",
resume_download=True,
)

测试模型代码：
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from transformers.generation.utils import GenerationConfig
tokenizer = AutoTokenizer.from_pretrained("./models/baichuan-inc_Baichuan2-13B-Chat-4bits/", use_fast=False, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(".models/baichuan-inc_Baichuan2-13B-Chat-4bits/", device_map="auto", torch_dtype=torch.bfloat16, trust_remote_code=True)
model.generation_config = GenerationConfig.from_pretrained(".models/baichuan-inc_Baichuan2-13B-Chat-4bits/")
messages = []
messages.append({"role": "user", "content": "解释一下“温故而知新”"})
response = model.chat(tokenizer, messages)
print(response)

完全按照model card操作，并且下载和测试其他模型不会报错。问题在哪？如何解决呢？