Improve locking and performance on asynchronous contact loading.