DAT-160: Adding step before sp pipeline is run which moves files from S3 to hdfs for distributed cache.