If pushed for time, the must-sees are, in order of importance, the Harem, the Treasury, and the Pavilion of the Holy Mantle.
The Harem is one of the places you must see.