setting max model length to reasonable number / max_pos_encodings, e.g. 8192
#11
by
michaelfeil
- opened
gemma has max positonal encodings of 8192 and add infinity description in readme. Ready for review.
michaelfeil
changed pull request title from
setting max model length to something reasonable, e.g. 4096
to setting max model length to something reasonable, e.g. 8192
michaelfeil
changed pull request title from
setting max model length to something reasonable, e.g. 8192
to setting max model length to reasonable number / max_pos_encodings, e.g. 8192