You can, however, that would impact the nutrition of this dish. If you're in a pinch and aren't Whole30 or Paleo, feel free to use a packet.