You can buy many Smithing Ingredients from Blacksmiths in all the major cities. As for jewels, there is a jewel and clothing store in Solitude near the General Goods store.