GGML quantize script?

#29
by MichelNivard - opened

Anyone have a script for quantizing replit finetunes for use with llama.cpp?

Yo, MichelNivard, it seems like you understand this. Can you help me to configure this model to my use case
@MichelNivard

Sign up or log in to comment