Various new changes. Stabilized the work queue use a bit.

There's still a data race whenever a controller is connected.
Once I properly setup mutexes, that should be done with.