Before revision:  The recently released SemBleu metric (Song and Gildea, 2019) is based on the machine-translation metric Bleu (Papineni et al., 2002) , increasing computational efficiency by ablating a variable-alignment step and aiming at capturing more global graph properties. Our aims are threefold: i) we establish criteria that allow us to perform a principled comparison between metrics of symbolic meaning representations like AMR;
After revision:  The recently released SemBleu metric (Song and Gildea, 2019) is based on the machine-translation metric Bleu (Papineni et al., 2002) , increasing computational efficiency by ablating a variable-alignment . In this paper, i) we establish criteria that allow us to perform a principled comparison between metrics of symbolic meaning representations like AMR;