Second mouse down (touch start) should cancel previous one.