Remove listener_thread from listener