Loading all safetensors cost

#13
by mohres - opened

Hello everyone,

is it necessary to load all the 44 safetensors to be able to use the model in a specific language?

yes

Yes, it took around 6h for me on 8xA100 80Gbs.

mohres changed discussion status to closed

Sign up or log in to comment