Yes, you should cover the apple crisp to protect from dust, bugs, etc., but you can keep apple crisp at room temperature for up to 2 days. This is of course as long as there is no ice cream on top. After storing at room temperature, you can refrigerate for an additional 3 more days. All in all, this apple crisp will keep for about 5 days after making.