Before revision:  Using our human-evaluation datasets, we show that widely used n-gram similarity metrics do not correlate with human judgments .
After revision:  Using our human-evaluation datasets, we show that widely used n-gram similarity metrics often fail to discriminate the incorrect answers since they equally consider all of the tokens .