GGUF
English
exbert
Eval Results
Inference Endpoints

How did you manage this conversion?

#1
by atorsvn - opened

How was this accomplished? Is there a script or tool to simplify this? I would like to fine tune then convert a distilgpt2

I think they used llama cpp?, idk i know llama cpp supports gpt2 so this might just be able to work.

Hey, sorry for the late response! Yeah, I don't recall using anything special for converting this, just llama.cpp's built-in conversion tools (maybe convert_hf_to_gguf.py, but it's been a while since I've done it)

Sign up or log in to comment