agnosticbin2: Do not start connecting pads until stream is started

Change-Id: I1e8d9967bf6c225eb01573e46303fd11cdf359a7