Adding `safetensors` variant of this model
This is an automated PR created with https://huggingface.co/spaces/safetensors/convert
This new file is equivalent to pytorch_model.bin but safe in the sense that
no arbitrary code can be put into it.
These files also happen to load much faster than their pytorch counterpart:
https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb
The widgets on your model page will run using this model even if this is not merged
making sure the file actually works.
If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions
Feel free to ignore this PR.
Can this be merged please? much quicker for downloading and using tgi
Where is model-00002-of-00002.safetensors?
Yeah actually looks like the safetensors need to be remade before pushing.
Would be good to do this and have safetensors available.
Added PR https://huggingface.co/mistralai/Mistral-7B-v0.1/discussions/91 with both files. Can confirm from local testing that the model loads and runs successfully.