Fix pull to refresh triggering on any scroll up