Loss calculation always 0

#24
by sanipanwala - opened

Hello,

I'm trying to fine-tune the 34B model but during fine-tuning, I always get a loss 0. While I was able to fine-tune 7B and 13B models but not 34B.

Let me know if I'm overlooking this or please give me suggestions.

Thanks.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment