Revert "Setup finalizer thread as an auxiliary thread"

This reverts commit f0a86ed44c6378d0f78c8f7898b8c6fe99fbaad8.

Revert for now since it seems to cause problems (see last comment in
 #2118), so needs further investigation.