TASK DEFINITION: You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
PROBLEM: System Reference: there is a hotel called in the st regis san francisco and in the area of financial district south.
Original Reference: the st regis san francisco is located in the financial district south.

SOLUTION: 0

PROBLEM: System Reference: are you looking for breakfast brunch lunch or dinner?
Original Reference: what meal are you hungry for?.

SOLUTION: 1

PROBLEM: System Reference: shangri la vegetarian restaurant, is in the hayes valley or golden gate park call 4157312548.
Original Reference: shangri la vegetarian restaurant is in hayes valley or golden gate park, number is 4157312548.

SOLUTION:
0