TASK DEFINITION: You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
PROBLEM: System Reference: where would you like it to be near to?
Original Reference: where is that near?.

SOLUTION: 0

PROBLEM: System Reference: x is a cheap restaurant in the expensive price range near x.
Original Reference: x is a restaurant near x in the cheap price range.

SOLUTION: 0

PROBLEM: System Reference: can i double check you want a hotel that has internet?
Original Reference: did not quite understand that last reply. were you interested in a hotel with internet?.

SOLUTION:
0