Max Context Token Length

#1
by lazyDataScientist - opened

How many tokens should we expect from this model? 8k, 32k?

This model is 4k, although various scaling techniques should work fairly easily.

Awesome! Thank you!

lazyDataScientist changed discussion status to closed

Sign up or log in to comment