Investors should consider the cost of storage, transaction fees, and the risk associated with holding physical gold. They should also be aware of the purity of the gold and ensure they are buying from a reputable dealer.