Fix assert caused by doing 2 pushes when some replicas
need version update and others are missing.