Benchmarks: Handle dropped node

Handle cases where executor nodes drop from the cluster during
execution.