Cleaner shutdown for the plugin_manager.
Spawn tests within their own startup/teardown.
remove non generated tests.