vilm
/

Transformers
GGUF
English
Inference Endpoints

Help!

#1
by MrDevolver - opened

Hello,

I tested this model, I see it has a great potential. Its writing seems exceptional compared to other models of the same size to the point I wanted to make this my favorite model, but I have a big problem with it. No matter what I tried, I couldn't figure out the right settings for it. I spent hours testing different settings and while it had great ideas and writing, it seemed like writing from a novelist who went insane. It seems to want to write in great detail and depth so much that it loses track of what it was actually going to say and there's a lot of repetition. Repetition kills the whole experience and the settings didn't seem to make it much better. You could either end up with one word repeated forever, or get similar phrases written over and over just using different wording.

Just in case of that small chance I messed it up myself, please has anyone figured good settings for this model?

VILM org

Hi, please set your rope_freq_base to 1000000. i just found out about it.

Sign up or log in to comment