how mush input tokens does it support
#8
by
nuaabuaa07
- opened
I tried it in my project and return error. I think it is because I exceed the max token it support. I want to know the max token size it support
i guess it is 8192.
Yep, @Nilav is right. We've finetuned it from llama-3-8b which has 8k context length, but mostly only on data up to about 2k. YMMV for different context lengths but feel free to let us know how it's working for you.