Do cleanup only to directories that actually exist.