how to deal with number of tokens exceeded maximum context length

#25
by Janmejay123 - opened

how to deal with number of tokens exceeded maximum context length

@Janmejay123 depends on the library you are using. There should be some thing like n_ctx or just ctx and set that to a higher value like 2048 or 4096 or even 16000

@YaTharThShaRma999 Its showing like basic,avx,avx2 but no number of tokens

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment