The max positional embeddings is set to 2048. Is that correct? Shouldn't it be 4096?
· Sign up or log in to comment
