threadpool: move the removal work to other threads
threadpool ut: make the others safe too