Regarding Lemur-v1 Base's context window
#2
by
xingyaoww
- opened
Looks like the max_position_embeddings for Lemur-v1 Base was set to 2048: link.
Is this intended? Or is this a typo since LLaMA supports 4096 from the beginning, and Lemur-v1-chat also has max_position_embeddings being 4096.
Thank you for your reminder! We have fixed the max_position_embeddings to 4096.
ranpox
changed discussion status to
closed