Fix workers state maintenance -

 Only add/remove workers if the member has role "Worker"