TASK DEFINITION: You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
PROBLEM: System Reference: x is an italian restaurant in the moderate price range located in the x area.
Original Reference: x is an italian restaurant in the moderate price range in the x area.

SOLUTION: 1

PROBLEM: System Reference: arabian nights restaurant, is in the hayes valley or noma area with a moderate price range.
Original Reference: arabian nights restaurant has moderate price -s and is in hayes valley or noma.

SOLUTION: 1

PROBLEM: System Reference: where would you like it to be near to?
Original Reference: hello, welcome to the information system ! you can ask me for hotel -s, listed by pricerange, whether the hotel -s accept credit card -s, or have access to the internet. how may i help you today?.

SOLUTION:
0