The IRS suggests that you retain records forever or at least until the matter is resolved if you fail to file a tax return for a given year or if you file a fraudulent return. Most states follow guidelines similar to those recommended by the IRS.