Support generic Hadoop Compatible Filesystem

This is a shortened version of PR #358, with focus on filesystem only.
Good point, I believe Intel released a hadoop plugin for lustre but I am not sure about how it is released, I'll talk to lustre community about it.