An unpaid or partially paid federal tax lien can have a significant negative impact on your credit score.