Your plant has caterpillar infestation when there are signs of holes in leaves, stripped foliage, and visible caterpillars on the plant.  Check the underside of leaves and the soil around the plant for signs of caterpillar activity. The underside of leaves is where caterpillars tend to hide from their natural predators, such as birds.