vocab size mismatch
#9
by
mradermacher
- opened
config.json says vocab_size is 32000 while instruct uses 32768. it also doesn't load properly. I don't think the vocab size should differ, and I suspect the size should be set to 32768 just like in the instruct model (which does load).
The problem is that the vocab size is different. The model state dict is actually 32000 as in the config.