Context size on openrouter
Hey @Sao10K , I was trying to test your model on OpenRouter, but it seems to be artificially limited to 8K context size. Is that on purpose or just a mistake?
Link, just in case: https://openrouter.ai/sao10k/l3.3-euryale-70b
I have no clue how it works on OR, it depends on provider?
I don't control what they host
Eury v2.3 is a Llama 3.3 model so it's fine up to 128k as the base is, though I'd recommend up to 32k
I thought you were the one posting it (no idea how that shit works either, I just saw you name and assumed you had some level of control).
Welp, I'll ask them, but it's probably a bust as they likely do it to save processing power/time.
Thanks for the quick answer. (and yep, i assumed as much about the 32k-ish tks)
Cheers.
EDIT: As expected, they do it on purpose.