Some of the downsides of an IRA account (regardless of its type) include penalties for early withdrawals, contribution limits, mandatory withdrawals (required minimum distributions), and limited types of investments.