By default, if the Exception is thrown out of the DeployableContainer, Arquillian Core should attempt to undeploy it later in the lifecycle.