Transformers 4.39.0.dev0 Framework

by Taylor658 - opened Mar 10

Mar 10

When Transformers 4.39.0.dev0 gets updated later to a new stable release, do you think there might be any difficulties in making sure Zephyr 7B Gemma continues to work well? I'm curious if starting with Transformers 4.39.0.dev0 could cause any issues down the line.

alvarobartt

Hugging Face H4 org Mar 12

Hi @Taylor658 , indeed the 4.38.2 version was used, but due to the issues within Google's Gemma and RoPE, transformers was being installed from source, but you're safe to pin it to 4.38.2 to be able to reproduce 1:1 the results they got with zephyr-7b-gemma-v0.1 🤗

See the transformers v4.38.2 release notes at https://github.com/huggingface/transformers/releases/tag/v4.38.2

Taylor658

Mar 13

Hi @Taylor658 , indeed the 4.38.2 version was used, but due to the issues within Google's Gemma and RoPE, transformers was being installed from source, but you're safe to pin it to 4.38.2 to be able to reproduce 1:1 the results they got with zephyr-7b-gemma-v0.1 🤗

See the transformers v4.38.2 release notes at https://github.com/huggingface/transformers/releases/tag/v4.38.2

Ok that makes sense...thanks

Taylor658 changed discussion status to closed Mar 13

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment