How convert my finetuned model to gguf?

#7
by HirCoir - opened

Hello, I have used a deepseek model as a base but I cannot convert it to gguf using llama.cpp, I have tried everything and nothing works... How do I convert them to gguf?

your issues converting the model might be related to the fact that the model uses a BPE tokenizer

Sign up or log in to comment