No, the only part of the cauliflower you need to remove is any outer leaves. The stem is needed to hold it all together.