Don't modify user with no flags specified