[backport] fix livelock happens when merging node restarted during the process.