Moving to Spark only method

use disk for temp file storage