Can anyone help on this phenomenon? Fine tuning intfloat / e5-mistral-7b-instruct got nan loss and all NaN intermediate model outputs

#37
by jhyapple - opened

v1.png

v2.png

jhyapple changed discussion title from Fine tuning intfloat / e5-mistral-7b-instruct got nan loss and all NaN intermediate model outputs to Can anyone help on this phenomenon? Fine tuning intfloat / e5-mistral-7b-instruct got nan loss and all NaN intermediate model outputs

Sign up or log in to comment