Yes, grilling the chicken can add a smoky flavor to the dish. Just ensure it's cooked thoroughly before adding the other ingredients.