It's a good idea to refrigerate no-bake cookies so they stay fresh, especially in the hot summer months. Besides, keeping them chilled in the fridge creates a little more crunch to the crust of the cookie, thanks to the firming up of the coconut oil.