Use a regular form alter to set the defaults, rather than the patch to help semantic_panels.