Remove useless check

See explanation here:
https://github.com/hypothesis/h/pull/1720#discussion_r20963012
Merge pull request #1723 from hypothesis/simplify-scrolling

Remove useless check