Write the collection agency a letter. Think of it as a simple business deal: if you pay some or all of the debt they claim you owe them, they will remove the negative item from your credit report. Ask for the agreement in writing. You can find some sample pay for delete letters below.