Remove resumeReads call when the listener is not set