You can. It will take on a different spice flavor, but it will still be spicy. You can also add the spices separately if you would like: 2 tsp. Cinnamon, 1 tsp. Ground ginger, ½ tsp. Ground cloves, ½ tsp nutmeg.