TASK DEFINITION: You are given an original reference as well as a system reference. Your task is to judge the informativeness of the system reference. If the utterance provides all the useful information from the meaning representation output 1, else output 0.
PROBLEM: System Reference: may i ask near where?
Original Reference: sorry in which area do you want a hotel?.

SOLUTION: 0

PROBLEM: System Reference: the phone number for eiji is 4155588149.
Original Reference: the phone number for eiji is 4155588149.

SOLUTION: 1

PROBLEM: System Reference: there is a hotel called in the hotel metropolis and in the area of noma.
Original Reference: hotel metropolis is in the area of noma.

SOLUTION:
0