Spark job fixed.