Don't abort touch handling while still dragging.

If touch events are ignored during an ongoing drag, and the drawer is dragged closed to the edge where it opens from, the state is not set to STATE_CLOSED.  It is not possible to subsequently open the drawer while in this state, so this change prevents this state.