Switch to using a semaphore (mostly a built-in of the kazoo client)