TASK DEFINITION: You are given an original reference as well as a system reference. Your task is to judge the informativeness of the system reference. If the utterance provides all the useful information from the meaning representation output 1, else output 0.
PROBLEM: System Reference: what area are you looking for a hotel in?
Original Reference: what area do you need.

SOLUTION: 0

PROBLEM: System Reference: bund shanghai restaurant 's address is 640 jackson street.
Original Reference: bund shanghai restaurant 's address is 640 jackson street.

SOLUTION: 1

PROBLEM: System Reference: may i ask near where?
Original Reference: would you like a hotel that is nearby?.

SOLUTION:
0