Yes, you can use frozen bell peppers and onions, but keep in mind that the texture and cooking time may vary. Frozen vegetables tend to release more moisture when cooking, so you might not get the same level of char or crispiness as with fresh vegetables. You may need to extend the cooking time by a few minutes to ensure they are fully cooked.