How to compile to a gguf file?

by Jasper17 - opened Mar 25

Mar 25

May I ask what compiler tool you used to compile it to gguf format?

Compendium Labs org Apr 20

Sorry, missed this before! I used the convert-hf-to-gguf.py script in the llama.cpp repository.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment