Holes in siding often indicate that insects are burrowing into your walls. Holes can also be caused by other animals, like woodpeckers. Lawnmowers and other equipment can stir up small stones that can damage siding, and hail impacts can cause holes too.