TASK DEFINITION: You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
PROBLEM: System Reference: red door cafe, is in the hayes valley or cathedral hill area and it is address is 1608 bush street.
Original Reference: red door cafe is in the hayes valley or cathedral hill area. the address is 1608 bush street.

SOLUTION: 0

PROBLEM: System Reference: i am sorry but there are no hotels in the area of north waterfront.
Original Reference: i am sorry but there are no hotel -s in the north waterfront area.

SOLUTION: 0

PROBLEM: System Reference: may i ask near where?
Original Reference: in which area would you like your hotel?.

SOLUTION:
0