Don't leak additional timeouts on reconfiguring
Reap spawned processes