Fix bug that a rebalance msg can be lost during rebalance