Add/Remove wallets to the connected peers as they are added/removed
to/from the PeerGroup