Removing the user, based on recent changes