If you own physical gold or silver and it increases in value, you might need to pay capital gains tax once you sell it. Contact your accountant to find out more about applicable taxes.