You need to refrigerate the cake while the Jello sets and if you're using Cool Whip or whipped cream. You can leave the poke cake out while you're serving it or for a potluck. Poke cakes go fast!