Distributor restart causes dropping of available workers

This fixes #2033