Write a Goodwill Letter: If you've already paid off the account and didn't get a pay-for-delete agreement, you can still use a goodwill letter to request that the collection agency remove your resolved account from your credit report.