Handle the fact that an empty directory created on HDFS affects the byte...

...s written counter, so if we want to use this counter to accurately warn when no records are written we must be able to detect empty directories. In passing fix order of operation bug that was causing completed job warnings to be over written by running job warnings resulting completed job warnings being lost