Newer scoring (FICO 9 and Vantage scores 3 and 4 ) models do not count collections that don’t have a balance. So, if you pay a collection off it could improve your credit score. However, if a creditor you're applying for credit with is using an older scoring model, your score will not improve.