#42: removed logging.
Hadoop was throwing org.apache.hadoop.util.Shell$ExitCodeException which indicated permission violations (according to stackoverflow). Apparently the cluster did not like the LOG logic, probably because it was trying to write the log file in some folder where we don't have write permissions.
Commenting out all LOG statemenets and excluding the log4j2-test.xml log configuration file solved this issue.