No, the broccoli stalks are completely edible and provide a slightly different texture compared to the florets. You can trim off the tough outer layer if desired, but the stalks can be cooked and enjoyed alongside the florets.