I don't recommend baking frozen tilapia fillets. Thaw your fish fully before cooking it so that it can cook evenly and perfectly.