The issue is that social justice is unfair and doesn't contribute to general well-being. On the contrary, it's an inherently unfair idea because it's violent. It's unfair because the state is financed through taxes and taxes are collected coercively, or can any of us confidently say that they pay taxes of their own free will. This implies that the state is funded through coercion and that the higher the tax burden, the greater the coercion leading to a reduction in freedom.