What's the context window for this model?
#2
by
siddheshgunjal
- opened
What's the context window for this model?
Hi
@siddheshgunjal
Please refer to my comment here: https://huggingface.co/google/gemma-7b-it/discussions/73#65e6ce0832fb3079c88e01ba
Since model default config has sequence length of 2048, so can i fine-tune for more and will it work ?