Try to avoid scrolling too far outside of bounds