According to his book, Lafitte was born in or near Pauillac, France, the son of Pierre Lafitte and his second wife, Marguerite Desteil.
Sipas librit të tij, Lafitte ka lindur në ose pranë Pauillac, Francë, i biri i Pierre Lafitte dhe gruaja e tij e dytë, Marguerite Desteil.