more fixes to spark-jobs