codellama

/

CodeLlama-7b-hf

like 305

You need to use the transformers from mainline and import it, but anyway I used LlamaTokenizer instead (because the other one complains about naming) and it worked just fine :)

the fix is to uninstall tokenizers, transformers, and accelerate. then rerun pip install git+https://github.com/huggingface/transformers.git@main accelerate

That's exactly right, you need to install transformers from main as explained by @Choms and @cassanof . This is because the changes to support Code Llama have not been published as part of a pip release yet (they were written last Friday 😅)

I think there is an active issue being discussed here: https://github.com/huggingface/transformers/issues/22222

Oh thanks @pcuenq for that update.