Only delete avatar if the user has one