size of vocab_size and tokenizer model off by 1

by daboe01 - opened Mar 24, 2023

Mar 24, 2023

tokenizer.vocab_size(): 32000
model.embed_tokens.weight: 32001

Mar 25, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment