Caterpillars may seem harmless to us humans. However, they can create trouble too. Box caterpillars can be toxic to humans. Therefore, it is always good to take precautions when dealing with caterpillars in your garden.