TASK DEFINITION: You are given an original reference as well as a system generated reference. Your task is to judge the naturaleness of the system generated reference. If the utterance could have been produced by a native speaker output 1, else output 0.
PROBLEM: System Reference: what area would you like the restaurant to be in?
Original Reference: what area are you searching for a restaurant in?.

SOLUTION: 1

PROBLEM: System Reference: there is a lebanese restaurant called arabian nights restaurant.
Original Reference: there is a lebanese restaurant that is called arabian nights restaurant.

SOLUTION: 1

PROBLEM: System Reference: la traviata, is moderate.
Original Reference: la traviata is in the moderate price range.

SOLUTION:
0