Fixing issue with Listener leave being incorrectly propagated

If we are attaching to a stream already being Listener to down stream,
mark it as not propagated so that we do not propagate a Leave when we disconnect