Yes, the green leaves are inedible due to their high concentration of oxalic acid, and consuming the leaves can cause rhubarb leaf poisoning. They are not toxic to the touch, though, so simply trim the leaves off the stalks and discard.