Use a cleaning solution of warm water and mild liquid detergent to clean the fountain, pump, and stones, or a professional calcium lime removal product. Spray distilled white vinegar on the interior and portions of the water fountain for an all-natural alternative, then scrub with a moist sponge.