We should clean or replace the ignitor on our furnace when it shows signs of wear or damage. It's important to regularly inspect the ignitor for any cracks, corrosion, or breakage. If the ignitor is visibly worn out or fails to glow when the furnace is turned on, it's time for a replacement. Cleaning or replacing the ignitor ensures proper ignition and helps prevent issues like a furnace not igniting when needed.