When you create the job, it forks the configuration, so we can't use getConf().set after that point, we have to set it directly on the job configuration.