There can be surprisingly detrimental effects if you don't clean your gutters regularly. The best time to clean gutters are during the fall and spring seasons, especially in late autumn before winter so you can clean out any fallen leaves.