[dist] Clean worker dirs on startup

Ensure that there is nothing left in there. Especially
when changing worker types there can be artefacts propagating
into the build (e.g. preinstallimages picking up previous
build root images)