Adding `safetensors` variant of this model
this looks good no?
Yes, it is ready for merging :)
Thanks a lot for the PR! Can confirm it works!
Tested it with: https://huggingface.co/spaces/safetensors/safetensors-checker
@ybelkada Very cool space! What does it test exactly?
@cakiki it tests if the conversion torch->safetensors was done successfully, i.e. if the keys of the state dict created by safetensors are the same + if the weights are the same, it only supports single file format though (does not support sharded models yet - I guess for that one can just load a model using from_pretrained and revision and confirm if the logits of a given input are the same between the 2 models)
@ybelkada Very cool, thank you! I tried to use it for this PR but it failed because I think the safetensors file is sharded: https://huggingface.co/bigscience/bloomz-mt/tree/refs%2Fpr%2F3 Is this not yet supported?
@ybelkada I was too quick commenting obviously, seeing as how I ignored everything in parentheses :D
The feature you requested should be supported in https://huggingface.co/spaces/safetensors/safetensors-checker/discussions/2 but I think we'll need to upgrade the Space hardware to avoid CPU crash