Shutdown worker threads after dry run is complete, so that we are
not getting those nasty errors after the run is complete.

Exception in thread Thread-208 (most likely raised during interpreter shutdown)