Add in failing test case for starting the configuration subsystem late,
which appears to NOT work