Revert "workqueue: Yes more B.S. for this nagging bug"

This reverts commit 9fffcdab0afb1fab735f67220f06c9af821b5d25.