facebook

/

opt-2.7b

like 80

Follow

AI at Meta 3,381

I have tried model.generate(**inputs, return_dict_in_generate=True, output_scores=True) but it only gives the scores for generated tokens. For my application, it would be convenient if there’s a similar parameter to echo in the OpenAI GPT-3 API that lets us access prompt scores/logprobs, but I have yet to find it. Any help is appreciated!