num_return_sequences and num_beams > 1

#17

by tlphams - opened Feb 3, 2023

Feb 3, 2023

Hi,
Does SantaCoder support returning multiple sequences? I have tried setting num_return_sequences = 4 and num_beams = 4, but the results is so different and not as good as num_return_sequences = 1 .

cakiki

BigCode org Mar 13, 2023

Hello @tlphams , could you please provide more context as to how you're using the model for generation? Including code and outputs would be very helpful!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment