Revert "Remove useless check"
Merge pull request #1724 from hypothesis/revert-1723-simplify-scrolling

Revert "Remove useless check", because it caused problems with deleted annotations.