Before revision: Systems that generate sentences from (abstract ) meaning representations (AMRs) are typically evaluated using automatic surface matching metrics that compare the generated texts to the texts that were originally given to human annotators to construct AMR meaning representations . However, besides well-known issues from which such metrics suffer (Callison-Burch et al., 2006;
After revision: Systems that generate sentences from (abstract ) meaning representations (AMRs) are typically evaluated using automatic surface matching metrics that compare the generated texts to reference texts from which the input meaning representations were constructed. We show that besides well-known issues from which such metrics suffer (Callison-Burch et al., 2006;