We wouldn't have this enrichment of our society if it wasn't for slavery.

Does it follow that "If it wasn't for slavery, our society wouldn't be enriched this way."?
yes