Use folly connectionmanager intead

Summary: Split D1519919 in to two diffs so that open source builds could all work correctly

Reviewed By: @dcsommer

Differential Revision: D1563999