Kquant03

/

FrankenDPO-4x7B-GGUF

like 2

I've tried a few and gotten mixed results but what is most optimal?

I had the best time with chat-instruct using this template

hope this helps! I use ooba, I don't have much experience with VLLm or ST.