I don't like your rules. I happen to think it's OK for me to rob, plunder, rape murder and whatever else. Catch me if you can. So, we catch them. They aren't dissuaded.
Recidivism rates are very high.
And we pay several times. The fact that they've done whatever they've done has lots of other costs. Insurance for one. All of us pay for insurance to help defray the cost of crime when it strikes us. And not just our own insurance.