You can! If you'd prefer not to cook the chicken whole, you can cut the whole chicken into smaller pieces first, or use this recipe to cook whole, bone-in chicken breasts. Adjust the bake time as needed so that you don't overcook the meat.