[Fix JENKINS-23017] delete the tmp workdir also

In order to not leave unlimited directories created by the polling cycle
in the tmp directory which results in reaching the system limit for
subdirectory numbers we should also delete the workdir itself and not only its
contents.