Caterpillars can cause defoliation, which stresses trees and may lead to poor crop yields, reduced growth, or even death in severe infestations. Keep your trees well-watered to help them recover.