updates in spark module