No you don't, but it is called vegetarian cauliflower fried rice for a reason. I know not everyone is a fan of tofu but it's a great way to make vegetarian. Again the main point of cauliflower fried rice is to replace the rice and have more vegetables, so you can easily have some poultry or meat in place of tofu.