Although technically the gold in an IRA belongs to you, you will not get physical possession of it.
Gold is held either in-house with the trustee or at a third party location where it can be looked after unless you use a local storage option.
There are circumstances where you can access the physical stores of gold rather than trading them for their cash value, but this comes with large fees and taxes that usually makes it disadvantageous.