[FIXED JENKINS-24797] Add log4j configuration automatically