Fix issue where clicking on scrollbar causes orphan touches