>>It is well known that land and wealth has been acquired by expulsion of people from different faith from your territory (I'm thinking for example expulsion of Jews and Moors from Spain)

The problem with this line of argument is the land always belonged to somebody else first. The Moors took it from the Visigoths, who took it from the Roman Empire, who took it from Carthage, who took it from Celt-Iberian tribes that had been taking it from each other since time immemorial.

>>or taking it from natives of new territories (America, Africa)

Who were engaged in near constant tribal warfare against each other for the possession of territory. The Conquistadors had such an easy time toppling the Aztecs because two of their abused vassal states rose up in rebellion and joined the Spaniards (providing the bulk of Cortes' forces at one point). Africa's tribal kingdoms and regional empires show the same bloody history of conquest as any other region in the world.

Although it's certainly unsettling, one of the ever-present themes across human history is the legitimacy and endurance of conquest. Any attempt to challenge that legitimacy requires a coherent framework for dismantling the hierarchy and replacing it with a "fair" one (a fool's errand). This is precisely the task at which Marxism and its various Critical Theory descendants fail so spectacularly.

It's all well and good to say the current distribution of things is unjust and demands to be addressed. It's another thing entirely to actually do so "fairly" (and more importantly, peacefully). It seems to me far more likely that whatever agency or panel is authorized the enormous power necessary to affect such a change will inevitably abuse that power and merely replace the current hierarchy with a new one of their choosing. And the odds are that if mere government dictate could not accomplish it, they would resort to the same "violence, war, enslavement" that Marx was denouncing (i.e., conquering the conquerors). Friedrich Hayek put it this way: "Even the striving for equality by means of a directed economy can result only in an officially enforced inequality - an authoritarian determination of the status of each individual in the new hierarchical order."

I'm reminded of the thought experiment in Rawls' Theory of Justice that he calls the "veil of ignorance"[0]. In short: before individuals enter a society they are totally blind to their own place in it (race, class, gender, wealth, etc), like a randomized spawn in a game. They are then asked to deliberate on the distribution of rights and resources before entering the society. Rawls concludes that everyone would agree on the most equitable distribution because they cannot know who they will be in this new society (e.g., a lopsided society where most people are incredibly poor or enslaved is a huge gamble to take).

What Rawls doesn't do is take things a step further and imagine what that utopian society would be like in practice. Once everyone "spawns" in and begins living (pursuing opportunities, acting out passions, planning for the future, etc) there are guaranteed to be unequal outcomes when some are more successful/economically valued/powerful/attractive/politically manipulative/etc than others. Soon enough the once-equals have established a new hierarchy, as human societies tend to do, and we're back to square one.

Marx was wrong to call Smith "childish", especially when his own ideals are so naively hopeful. Even in a hypothetical world where one could implement a completely "fair" redistribution of possessions, once people begin exercising their will and making choices, inequalities will inevitably emerge and Smith's view of original accumulation would play out.

[0] https://en.wikipedia.org/wiki/Veil_of_ignorance