Ghoulam was born in Saint-Priest-en-Jarez to Algerian parents. His father is from Batna, while his mother is from Annaba. He has eight brothers and two sisters, and his brother Nabil is a cross country runner that represented France at the 2004 IAAF World Cross Country Championships.