And, finally, I don't quite agree with your statements about how we judge people. We do what you say. That is, we limit their possibilities unreasonably and unjustifiably. BUT, we also are social creatures who are determined by our pasts and the networks we find ourselves in and while change is possible at any level, it is not necessarily likely or worthy of betting on with our scarce resources. The problem is that we are not responsible for our choices in the matter rather than, necessarily, the actions we take in that regard.
Intelligence is the underlying organisational principle of the universe.