A minute bug
#1
by
sethuiyer
- opened
I noticed that model.safetensors.index.json is not proper for the model, 00029 should be replaced with 00005.
exllamav2 does not use that file at all. During quantization, the file is not rewritten, so the original contents remain in that file.
I see, alright!
sethuiyer
changed discussion status to
closed