reverted the change on the inmemory mode
simplified the hadoop mode now there is only one job per layer