How can I access prompt scores/logprobs?
#12
by
nickhu
- opened
I have tried model.generate(**inputs, return_dict_in_generate=True, output_scores=True) but it only gives the scores for generated tokens. For my application, it would be convenient if there’s a similar parameter to echo in the OpenAI GPT-3 API that lets us access prompt scores/logprobs, but I have yet to find it. Any help is appreciated!