The Internal Revenue Service (IRS) sets all IRA distribution rules, including age limits and penalty fees associated with early withdrawals from IRAs.