fixed generation_args in Sample inference code

#73

by dkleine - opened Jun 13

←

Jun 13

fixed temperature for "do_sample": False (temperature=0.0 would require sampling, which is turned off with "do_sample": False. therefore better to use temperature=1.0 without sampling)

Jul 3

•

The temperature setting actually doesn't make sense imho because it would only work if sampling is enabled with "do_sample": False

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Cannot merge

This branch has merge conflicts in the following files:

· Sign up or log in to comment