Add PeerManager, which automatically adds and removes peers as needed.