Although it's probably best known for flavoring autumn-themed pumpkin spice lattes at Starbucks, pumpkin spice is frequently used for amping up fall baking made with pumpkin, such as pumpkin pie, muffins, pumpkin cake with cream cheese frosting, and cheesecake.