Removing listener from the publisher