To remove peeling paint from gutters, you will need to use a wire brush or paint scraper. Wire wheels found on drills can also work. Make sure you clean the sanded space after scraping the paint off and use a solvent to remove oil.