Yes, the Marsala used to make chicken Marsala is wine and alcoholic, different from the cooking wine. While chicken Marsala gets its namesake and signature flavor from the wine, if you prefer to make this dish without alcohol, you could substitute more chicken broth.