For the best baked chicken breasts that are tender, juicy and delicious, the chicken should be completely thawed. If using frozen chicken, thaw it completely by placing it in your refrigerator overnight.