Safetensor model file

#1
by fakezeta - opened

Hi @acon96 ,

I'd like to convert your model to OpenVINO IR format but I cannot find a path to convert GGUF to any other format.
Can you kindly upload a safetensor model?

Thank you

Seconding this, would like to create a TensorRT format to run on triton :)

Owner

I have uploaded the source PyTorch model to the safetensors branch of this repo: https://huggingface.co/acon96/Home-3B-v3-GGUF/tree/safetensors

Sign up or log in to comment