Problems with Transformers 4.45.1

#36
by ctranslate2-4you - opened

There is apparently a change with Transformers 4.45.1. The model was working with Transformers 4.44.2. The error I'm getting is as follows:

ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side'

I believe it stems from something changes within transformers version 4.45.1 compared to version 4.44.2, but I'm unable to find it:

https://github.com/huggingface/transformers/compare/v4.44.2...v4.45.1

Can you please look into this? I'd like to use transformers==4.45.1 or higher because it supports llama 3.2.

It's my best guess that there's an issue with your "modeling" code, which I'm required to use by passing trust_remote_code=True. Thus, you may need to modify it to make it compatible with people who use both older and newer versions of transformers.

Here's a summary of the issue as far as I got (provided by AI):

The error "ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side'" indicates that the _pad() method of the ChatGLM4Tokenizer class doesn't accept a 'padding_side' parameter, but somewhere in your code or in the library's internals, this argument is being passed.

Here are some additional portions that I think might be relevant showing changes within transformers 4.45.1:

image.png

image.png

Sign up or log in to comment