Simply put, if you owe a large sum in taxes, it's likely because you kept too much of your paycheck during the year and had too little withheld automatically. If you owe more than $1,000, you also have to pay a penalty to the IRS