Problem with transformers version

#8
by MRNH - opened

in
model = AutoModelForCausalLM.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/anaconda3/envs/dir/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 521, in from_pretrained
config, kwargs = AutoConfig.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/anaconda3/envs/dir/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1130, in from_pretrained
raise ValueError(
ValueError: The checkpoint you are trying to load has model type starcoder2 but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

Can u provide a solution to this problem? I'm using 4.38.2 transformer version.

BigCode org

@MRNH you should install transformers from the repo (instead of released versions).

pip install git+https://github.com/huggingface/transformers.git

thank you for the quick answer it works now

When I install the version from the repo, I get the next error:

ImportError: cannot import name 'top_k_top_p_filtering' from 'transformers' (/home/user/miniconda3/envs/genai/lib/python3.10/site-packages/transformers/init.py)

When I install the version from the repo, I get the next error:

ImportError: cannot import name 'top_k_top_p_filtering' from 'transformers' (/home/user/miniconda3/envs/genai/lib/python3.10/site-packages/transformers/init.py)

I solved this by cloning the repo, checking out to commit b27aa20 and using pip install -e .

I am also facing the error cannot import name 'top_k_top_p_filtering' from 'transformers'. I tried with your suggestion to check out b27aa20, but not working.
Could you please give the full pip install command to try with

Sign up or log in to comment