Yes, you can absolutely bake the chicken instead of grilling it. See the recipe card below for recommended cook times for different cooking methods.