Actually wait until listener thread is alive