TASK DEFINITION: You are given an original reference as well as a system reference. Your task is to judge the informativeness of the system reference. If the utterance provides all the useful information from the meaning representation output 1, else output 0.
PROBLEM: System Reference: x is an expensive restaurant, in the x area near x, and x.
Original Reference: x is an expensive restaurant in the x area near x and x.

SOLUTION: 1

PROBLEM: System Reference: pontiac hostel hotel has which.
Original Reference: okay well you can find the pontiac hostel hotel at 509 minna st and will be able to use the internet there and if you need to call them their number is 4158637775.

SOLUTION: 0

PROBLEM: System Reference: what area are you looking for?
Original Reference: what area specifically are you interested in?.

SOLUTION:
0