Yes, you can use frozen grilled vegetables, but make sure to thaw them completely before baking, so that they won't release water while cooking.