Properly notify listeners when data listener thread goes down