ValueError: Non-consecutive added token '<|endoftext|>' found. Should have index 50258 but has index 50257 in saved vocabulary.

by rabintang - opened May 16

May 16

ValueError: Non-consecutive added token '<|endoftext|>' found. Should have index 50258 but has index 50257 in saved vocabulary.
加载模型出现如上错误，请问是什么原因

wuuzi

about 1 month ago

update transformers 到4.35以上

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment