q4 versions please

#1
by HR1777 - opened

Please release q4 variant too.

Uploaded.

dranger003 changed discussion status to closed
dranger003 changed discussion status to open

Looks like the tokenizer is broken... I'm looking into it. Right now the model generates junk for me.

Uploaded a new version, this one should work now.

dranger003 changed discussion status to closed

Thank you so much!

Sign up or log in to comment