A Bleeding Heart plant is a poisonous plant, but caterpillars are the one little pest that seems immune to the toxin. In fact, if another animal eats a caterpillar after it has munched on a Bleeding Heart plant, that animal becomes ill. I have found that Neem Oil works well in getting rid of plant pests on a Bleeding Heart plant and does not harm the plant.