Fix bug where fallback onto native scroll happens more than once