Benevolent societies were formed by different ethnic groups, from French Huguenots to free people of color to Germans to Jews