You do not need to rinse off your feta cheese before using it. The nice salty brine that the cheese was packed with will help to enhance the flavors in this dish wonderfully.