set SparkSQL compression use HiveContext.setConf
clean up, instantiate new DDF using manager.newDDF