why the paddings are shown in the left of content, is it a bug or something?

#59
by YJie - opened

as Title show

It is expected since there is a setting "padding_side":"left" in tokenizer.config.
But I don't know why the model is designed such that the paddings filled on the left side.

BigScience Workshop org

That's because the model is decoder-only and has not been trained to continue from padding tokens.

christopher changed discussion status to closed

Sign up or log in to comment