You can add the pumpkin layer right away, but it will end up with more of a swirled look.