how to deal with number of tokens exceeded maximum context length

#25
by Janmejay123 - opened

how to deal with number of tokens exceeded maximum context length

@Janmejay123 depends on the library you are using. There should be some thing like n_ctx or just ctx and set that to a higher value like 2048 or 4096 or even 16000

@YaTharThShaRma999 Its showing like basic,avx,avx2 but no number of tokens

Sign up or log in to comment