TASK DEFINITION: You are given an original reference as well as a system reference. Your task is to judge the informativeness of the system reference. If the utterance provides all the useful information from the meaning representation output 1, else output 0.
PROBLEM: System Reference: there are 54 cheap restaurants where kids are allowed.
Original Reference: there are 54 restaurant -s that allow kid -s and have a cheap price range.

SOLUTION: 1

PROBLEM: System Reference: what area are you looking for a hotel in?
Original Reference: which area would you prefer?.

SOLUTION: 0

PROBLEM: System Reference: what area are you looking for a hotel in?
Original Reference: in which area are you looking for a hotel?.

SOLUTION:
0