Please don't. It really makes a big difference, and greatly enhances the flavor of these scones. In my opinion, if you have all the ingredients for this recipe except for the orange, it's better to not make them until you do have an orange than to make them without the orange zest.