You can start taking penalty-free distributions from your account from age 59 and a half. IRS states that this can be iether you or the beneficiary of your Precious Metals IRA.