Fix where the user could interact with the views during a gesture