Fixes #31. Only move up if too far down on view