Failure to file taxes or even underreporting your business income to the IRS has serious repercussions, such as fines, penalties, and even jail time. Ignore this aspect of your business and you might not have a business anymore.