It is generally recommended to discard milk or milk products that show signs of spoilage, as the presence of microorganisms may indicate the growth of harmful bacteria or the production of toxins, even if visible signs are removed.