How to convert safetensor model into gguf?
#2
by
HildaM
- opened
I only have one 4090 graphic card, I wonder if it can convert Yi-9B safetensor model type into gguf?
I only have one 4090 graphic card, I wonder if it can convert Yi-9B safetensor model type into gguf?
Yes, you can follow the instruction in llama.cpp, https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#prepare-and-quantize
itsliupeng
changed discussion status to
closed