TASK DEFINITION: You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
PROBLEM: System Reference: x is an italian restaurant in the riverside area near x and x.
Original Reference: x is an italian restaurant in the riverside area near x and x.

SOLUTION: 1

PROBLEM: System Reference: thai cottage restaurant, is cheap.
Original Reference: thai cottage restaurant is a nice restaurant in the cheap price range.

SOLUTION: 1

PROBLEM: System Reference: may i ask near where?
Original Reference: where would you like a hotel?.

SOLUTION:
0