If you miss your Precious Metals IRA payment, you will be charged a late fee. If you fall significantly behind in your payments, your custodian may actually be able to sell some of the precious metals in your account in order to pay delinquent fees.