If you don't pay your taxes, the IRS can penalize you in multiple ways. The penalty depends on how much you owe and whether you filed your taxes on time. Some potential penalties include the IRS putting a lien on your property or garnishing your wages.