House siding should be replaced when it shows significant wear, damage, or inefficiency in insulation. The lifespan of siding varies by material, with some like vinyl lasting up to 20-30 years, while wood may require more frequent replacement or maintenance. Regular inspections can help homeowners determine when it's time to replace their siding.