Ludovici was born in London, England on 8 January 1882 to Albert Ludovici, and Marie Cals. Ludovici's father and grandfather, Albert Ludovici, Sr., were both artists. He was of Basque, French, German and Italian ancestry. He was educated privately, in England and abroad but chiefly by his mother. As a young student he became friends with Harry Guy Radcliffe Drew, whom he met at the Paris Exhibition of 1900. Years later he befriended Drew's young daughters Dorothy (later a student of F. M. Alexander) and Joyce (better known as architect Jane Drew). He married Elsie Finnimore Buckley on 20 March 1920, and they first lived at 35 Central Hill, Upper Norwood in South London. He spent several years in Germany where he studied Nietzsche's writings in the original German. He was fluent in several languages.