Penalties can include fines, interest on unpaid taxes, and missed opportunities for deductions or credits.