You would need to if they were topped with buttercream frosting, but royal icing doesn't need to be refrigerated, so it's best to keep your nutter butter cookie treats at room temperature.