Fixing test to properly block on startup.

TODO:
 - fix impl to reach into CP internals to set the correct failure policies