Moral of the Story. The IRS Saves Criminal Prosecution for Exceptional Cases. While the IRS does not pursue criminal tax evasion cases for many people, the penalty for those who are caught is harsh. They must repay the taxes with an expensive fraud penalty and possibly face jail time of up to five years.