In this case, due to the cream cheese filling, the answer is yes. That said, if you need a whoopie pie option that you don't have to refrigerate, you can replace the cream cheese frosting with buttercream frosting, which will allow you to store them at room temperature.