TASK DEFINITION: You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
PROBLEM: System Reference: red door cafe, is good for brunch, and no children are allowed.
Original Reference: the red door cafe is a cafe for brunch that does not allow child -s.

SOLUTION: 1

PROBLEM: System Reference: franciscan crab restaurant, is in the hayes valley or fishermans wharf area and it is address is pier 43 fishermans wharf.
Original Reference: franciscan crab restaurant is in the hayes valley or fishermans wharf area located at pier 43 fishermans wharf.

SOLUTION: 0

PROBLEM: System Reference: can i double check you want a hotel that has internet?
Original Reference: what is your preference as to whether it has internet?.

SOLUTION:
0