lipogram_private / reference_scores.csv
nathanael-fijalkow's picture
Improved logprob-based scoring
4d8bbd9
exercise,prompt_index,prompt,unconstrained_logprob,reference_logprob,reference_delta
exercise_1,0,Who is the king of the jungle?,-0.438915,-1.160570,-0.721655
exercise_1,1,Complete this: Once upon a...,-0.333118,-1.340559,-1.007441
exercise_1,2,What is the opposite of 'always'?,-0.204553,-1.405256,-1.200703
exercise_1,3,Name a fruit that is red.,-0.428213,-1.045869,-0.617657
exercise_1,4,What do you use to see things?,-0.485363,-1.388507,-0.903145
exercise_2,0,Where is the headquarters of Airbus located?,-0.372244,-0.689966,-0.317723
exercise_2,1,Complete this sentence: The Airbus A380 is assembled in the city of,-0.145879,-0.765407,-0.619529
exercise_2,2,Which city in southern France hosts the Cité de l'Espace space museum?,-0.169176,-0.571546,-0.402370
exercise_2,3,In which French city can you find the Place du Capitole?,-0.145984,-0.815522,-0.669538
exercise_2,4,Which French city is home to both Airbus and the Space Centre?,-0.213124,-1.147179,-0.934054