Fix tests to not ignore ordering and also assert all data is present

Realistically though, we must test by modification time (because we are reading in the write order) - since we close files, the mod times in Hadoop should be same as the order in which we wrote (Hadoop has milli second granularity on closed files)

Right now, since log files have the time in the name it is fine, but later if we decide to change that, these test would need to change.