Remove focus and active state on click/move