The Harem housed the private quarters of the sultan, his mother, and his many wives and concubines.
The sultan did not live in the harem with his mother.  
mnli hypothesis: The sultan did not live in the harem with his mother.   premise: The Harem housed the private quarters of the sultan, his mother, and his many wives and concubines.