The Limit You Need To Worry About Is $10,000 “$5,000 is okay, but if you withdraw more than $10,000, the transaction will be reported to the IRS and at least one other government agency,” Bakke said.