The Old Citesouqs offer all manner of Oriental wares (as well as much of less interest), whereas in the New Cite Yoel Salomon Street and Rivlin Street are good for arts and crafts, and Ben Yehuda and surrounding streets can supply most other items.
You can buy arts and crafts on Salomon Street, while the Old Citesouqs offer Oriental wares.