[contactsd] Improve contact change processing delay logic

Reduce the amount of contact changes we process individually.