updates spark worker