Handle connection outside of init

Important because churning workers will create lots of OS threads!