Allow switch to other gestures after finishing one but don't take into account possibl offsets