Clean only directories that still exist.