How was this gguf files created
#1
by
Berger-Ecommerce
- opened
Can you please provide the instructions you used to create these gguf files?
Same question. I used LlamaCpp convert-hf-gguf.py but failed. I also modified the convert-hf-gguf.py script (e.g., change the model type to BertModel) so that the model can be converted successfully. However, when loading the model, I encountered a "shape mismatch" error. Could you please share the process to get the gguf files? Many thanks!