To keep the feta from drying out, ensure that the cheese is surrounded by cherry tomatoes and olive oil, which helps to maintain moisture. You can also cover the baking dish with foil during the first part of baking if needed.