Yes, you can. In the toaster oven, bake the chicken for 35 to 45 minutes. To check the doneness of the chicken, use a meat thermometer. The internal temperature should be at least 165 degrees Fahrenheit.