finalize working directories configuration: now they can be read from SparkConf and set manually, their default values are moved to local temp dir