Yes, you can definitely use goat cheese as a substitute for feta cheese. It's your personal preference.