Quality seems to be different from the official demo

#4
by kz919 - opened

Thanks for the great work!!! I have been looking for some pretrained weights since I do not have the compute to do so.
When inputing the same prompt, it's giving some very different results especially in code generation. The official demo seems to be able to generate good executable code to simple leetcode problems, but this one fails to do so. Is it because of the model size difference?

Never mind you need the instruction template to make it work, but the weird thing is all the generation ends up with , which is super weird.

same issure

Sign up or log in to comment