Yes, you do need to refrigerate pineapple upside down cake after it is baked to keep the pineapple from going bad. Cool the cake completely and cover the cake with a cake dome or plastic wrap and refrigerate for up to 4 days.