Drug use is a victimless crime--the classic textbook example of a victimless crime--as I say here: Cue Card Libertarianism - Drugs.
In the present environment of prohibition, it's no accident that organised crime and petty crime is intertwined, nor that organised crime is heavily involved with providing something that is illegal.