Yes, all parts of the peony plant, including Paeonia lactiflora 'Honey Gold', may cause stomach discomfort if consumed, and they are toxic to dogs, cats, and horses. It is important to keep pets away from peonies and seek veterinary attention if ingestion occurs.