But he suffered from fragile self-esteem , alcohol and drug problems , and an addiction to ever more extreme forms of sex with rough young men , as well as an obsession with tattooing ( itself a means of access to such men ) all of which ultimately derailed him from his literary career .