Don't double the connection master stuff

Signed-off-by: Chris Lamb <chris@chris-lamb.co.uk>