After the bread pudding has cooled to room temperature store it in the refrigerator. If you're serving the bread pudding the same day as baking it, it can sit at room temperature for a couple of hours after it has cooled.