Pumpkin pie spice extract is a new invention that can be used when baking. Use it in the same way you would vanilla or almond extract. You can add this ingredient when mixing the dough or filling for things like pumpkin pie, pudding, or muffins.