Yes. You can remove the brown spots from a cauliflower so long as they are not mold spots.