While frozen stuffed shells can be baked without thawing, it is recommended to thaw them first for better texture. Thaw overnight in the refrigerator before baking.