The ingredients in this easy coconut cream pie recipe are perishable and so yes, you should always refrigerate coconut cream pie. Pies with dairy and milk in it and a custard filling like banana cream pie and chocolate mouse need to be stored in the refrigerator. Do not even leave it out overnight since bacteria can set if it is stored above 40 degrees F.