It may be pure or perverted. But it is never absent from the human soul. The idea of justice includes both the distinction between right and wrong, and the insistence the wrong be punished and the right praised. When we compare human societies we find that there is always a distinction made between right and wrong. More than that, we discover that the content of that distinction is roughly the same.
Humans everywhere approve of loyalty and decry treachery.
Honesty, truthfulness, and kindness are valued in Christian, Muslim, Marxist, and Hindu societies. Though the conception of ownership varies, the rejection of theft is ubiquitous. People cannot live without some modicum of justice in their relationships. The pursuit of justice is essential to the human experience. Atheism, however, cannot justify the existence of justice.