RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

by makongduo4112 - opened Apr 11

Apr 11

Hi guys,
Could you tell me how to fix below issue?
RuntimeError: probability tensor contains either inf, nan or element < 0

I just run the example in the model card.

my environment is listed below:
GPU： 1060
OS: windows 11
pytorch: 2.2.2
cuda: 12.1

Jun 9

Same issue occurs on qwen2-7b-instruct-int8

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment