There is another side to that coin. If you choose to climb a mountain and fall off, don't expect to be able to reach into someone else's pocket and take the money to patch yourself up. You best save up a lot of money or buy a good insurance policy before heading for the top of the mountain. Otherwise, your repair job will depend on the goodwill and charity of others. For the climber, or his agent, to take money from others for his use would be initiating force and violence against others.
Libertarians deplore the initiation of force and violence, by government or anyone else.
Such use of force and violence erodes and destroys civilization. Of all tyrannies, a tyranny exercised for the good of its victims may be the most oppressive. It may be better to live under robber barons than under omnipotent moral busybodies.