Transformers load error
#1
by
Dannyboy123
- opened
When trying to load in transformers via webui, I get the following error: SError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory models/ibivibiv_giant-hydra-moe-240b.
What are you using to load the model?
I have loaded it with webui as well. I used the transformers loader when using webui and then set all of the gpus to max out. I'm not 100% sure if it would load using cpp or other loaders since I haven't tried those.
Next time I load it up I will screen shot my settings, but they were all default outside of the GPU memory being raised to the max. I took this screenshot to check the memory footprint and this was after a load via webui.
ibivibiv
changed discussion status to
closed