An unpaid federal tax lien can remain on your credit report indefinitely until it is paid in full.