The cost basis of physical gold or silver is the amount paid for the metal, with certain costs allowed to be added. If the metals are received as a gift, the cost basis is the market value on the date of purchase or receipt. If the metals are inherited, the cost basis is the market value on the date of death of the previous owner.