Generally, taking physical possession of gold in your Gold IRA before reaching age 59 1/2 is considered a distribution and may result in taxes and penalties. However, once you reach that age, you have the option to choose whether you would like to receive your distribution as physical gold or cash.