tokens

#16
by mishavee - opened

Does the system have 2048 tokens? How many words is that approximately?

Is that total for both prompt and completion? Gpt3 seems to allow 4097 tokens total. Is it the same here?

BigScience Workshop org

Technically you can do much more than 2048 of tokens with bloom & bloomz as we use Alibi position embeddings, but havn't done experiments on that yet

what is alibi position embeddings?

what is approximate limit with it?

Sign up or log in to comment