Can't load model due to tensor shape mismatch
#1
by
shensmobile
- opened
ValueError: Trying to set a tensor of shape torch.Size([32000, 4096]) in "weight" (which has shape torch.Size([32002, 4096])), this look incorrect.
I get this error when loading into text-generation-webui. I manually edited the config.json to decrease the vocab size to 32000, but I get errors during inference instead.