Pumpkin bread pudding is best served warm within 30 minutes of coming out of the oven. Enjoy it with a big scoop of vanilla ice cream or maple syrup drizzle. You can also add whipped cream if desired. Some folks like to eat their bread pudding cold, but I'm not a fan of the consistency once it's refrigerated.