Moshe was born in Hebron to Israel and Simcha Mani, of the well-established Mani family. His great-grandfather was Rabbi Eliyahu Mani, the renown scholar who led the Jewish community of Hebron for 40 years. His father was Dr. Israel Mani, who served as a judge. The family survived the 1929 Hebron massacre when he was a child.