Hey TD,

Doesn't the modification time get fetches as _part of_ `listStatus`? Why does it require another API call?

If HDFS does not provide an atomic primitive for reading and `stat`ing files, then we should handle the race in a principled way inside of the PathFilter. For instance, the PathFilter could have the semantics that when it detects this case (FileNotFound) it just automatically excludes that file.

This is a very broad exception catch that could end up accidentally accepting all kinds of random exceptions anywhere down the chain. HDFS throws IOExceptions for almost every possible error that could happen.

Also, it's not good to assume that users won't constantly be deleting files - some user somewhere will probably do this (remember users will have some code relating to cleaning files in this directory anyways unless they want to have infinite amount of files).