What is the context size for Gemma? I get error when asking for it in the config file e.g., AttributeError("'GemmaConfig' object has no attribute 'context_length'")

#32

by brando - opened Mar 7

Mar 7

What is the context size for Gemma? I get error when asking for it in the config file e.g., AttributeError("'GemmaConfig' object has no attribute 'context_length'")

ybelkada

Google org Mar 13

•

edited Mar 13

Hi ! I think it should be 8192: https://huggingface.co/google/gemma-2b/blob/main/config.json#L14

ybelkada

Google org Mar 13

This has been confirmed by the author here: https://huggingface.co/google/gemma-7b-it/discussions/73#65e9678c0cda621164a95bad

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment