They worked with slaveholders in the South to urge a paternalistic institution