Generates random output

#1
by AliceThirty - opened

I am loading the Q_4_M model on Koboldcpp latest version
image.png

image.png

disable mmq
use flashattention

Thank you !

Sign up or log in to comment