Whether the IRA is your own or inherited, failure to withdraw an RMD by the deadline results in one of the most onerous penalties in the tax code: 50%. That's right. If you were supposed to take out a minimum of $4,000 and- oops!- did not do so, you have the privilege of writing the IRS a check for $2,000.