The ConfigurationSolver now stops all plugins when the runner is disabled.