commit all spark changes