As your cauliflower sits a while on your counter or fridge it may most likely start to develop brown spots on them. Even at the stores. It is quite ok to shave them off using a knife or peeler and still be able to use the cauliflower as you normally would.