Before revision:  In other words, given a gold paragraph and knowing whether it contains an answer or not, models easily outperform a single annotatorin both datasets.
After revision:  In other words, given a gold paragraph and knowing when to abstain from answering, existing models easily outperform a single annotatorin both datasets.