And that, in my opinion, also points up the difference between Libertarians and Republicans. For Republicans justify force to protect not just members of society, but society itself, from actions they see as threats to society. There is considerable difference among Republicans as to which actions constitute such threats, accounting for the broad spectrum between conservative Republicans and libertarian Republicans. But where any harm comes to society, it is from actions associated in the public mind with the victimless crime, even though that association is not always justified. For example, the drug user who steals to support his drug use should be prosecuted for the stealing, not for the drug use.
Similar arguments are advanced, and can be similarly rebutted, regarding other victimless crimes.
Each of them is seen by Libertarians as a freedom and by conservatives as a threat to society, while Republicans pick and choose which ones to support and which to oppose, reflecting their own positions on the political spectrum. Some of these are difficult to handle. Some people may be overwhelmed by freedom and might destroy themselves. But the right to vote is difficult to handle responsibly too. To a Libertarian, it's not certain items on the menu that constitute freedom, it's the menu itself.