TASK DEFINITION: You are given an original reference as well as a system reference. Your task is to judge the informativeness of the system reference. If the utterance provides all the useful information from the meaning representation output 1, else output 0.
PROBLEM: System Reference: there are 2 hotels in nob hill with price range and are you pricey for a hotel that accepts credit cards.
Original Reference: 2 nob hill hotel -s are pricey and accept credit card -s.

SOLUTION: 0

PROBLEM: System Reference: la traviata, is moderate.
Original Reference: la traviata is in the moderate price range.

SOLUTION: 0

PROBLEM: System Reference: what area are you looking for a hotel in?
Original Reference: what part would you like to be in?.

SOLUTION:
0