Yes, but you'll still have to cook the chicken first in the skillet, so oven-baking will add an extra step and more dishes to wash. But if you'd like, you can briefly saute the chicken, then place it in a rimmed baking dish, coat it with the sauce, and bake until cooked through - try 30 minutes at 350°F, stirring midway through baking.