While it's tempting to barter off any rubies and sapphires you find immediately, don't sell gems to the Merchant on their own. They are always best kept for slotting into inlay items because you can get bonus money by making patterns in the jewellery.