Allow clearing of user modes as well