xu-song's picture
update
9495a4f
|
raw
history blame
675 Bytes

Exception: data did not match any variant of untagged enum ModelWrapper at line 108219 column 3

The OrderedVocab you are attempting to save contains a hole for index 50254, your vocabulary could be corrupted !

The OrderedVocab you are attempting to save contains a hole for index 50254, your vocabulary could be corrupted !
The OrderedVocab you are attempting to save contains a hole for index 50255, your vocabulary could be corrupted !
The OrderedVocab you are attempting to save contains a hole for index 50256, your vocabulary could be corrupted !

原因:50254 这些token并未在vocab中定义,只在 added_tokens 里定义了。

ss