BOS Token

#1
by 1AH - opened

Is this correct?

llm_load_print_meta: BOS token        = 151643 '<|endoftext|>'

Weirdly yes πŸ€·β€β™‚οΈ in theory it can be anything, the model just sees the token ID, but this is the correct ID which maps to <|endoftext|> haha

Thanks for the sanity check (and the quant.) Model works great, but that sure looks weird at the start of a prompt.

1AH changed discussion status to closed

Sign up or log in to comment