Abandon focus when loosing focus anyways