Check if mouseup/touchend are triggers and exit early