vilm
/

Transformers
GGUF
English
Inference Endpoints

ROPE Freq. Base should be 1000000

#1
by Alastar-Smith - opened

If model don't work for you correctly, check the rope setting, should be 1000000.

VILM org

Thank you so much! I was figuring out what happened too!

I don't think this was fixed yet, unlike in Plus version. I found out the hard way after downloading and trying. :(

VILM org

@MrDevolver yes, give me about half a day to a day, i will have it upload. Sorry it is holidays where I live rn so I am a bit behind.

@MrDevolver yes, give me about half a day to a day, i will have it upload. Sorry it is holidays where I live rn so I am a bit behind.

I'm sorry, I didn't know you have holidays where you live. It's alright, this can wait. I'll be looking forward to a fixed version of the model. In the meantime, enjoy holidays and thank you in advance! 🌹❤

VILM org

@MrDevolver the GGUF are updated! lmk if the performance matches your expectation :P

qnguyen3 changed discussion status to closed

Sign up or log in to comment