icio/pyfilesystem — pull request #2 by tarnfeld (2014-07-17 08:52:41+00:00)
Title: Implement a HDFS filesystem using the WebHDFS API

I've implemented a PyFS class that supports all methods, via the speedy WebHDFS API available in Hadoop 2. This can be a preferable alternative to using some of the available C libraries for interacting with HDFS or using a subprocess to `hadoop fs -ls /` and parse the output.

It's still WIP and needs more testing, I don't think it fully passes all of the PyFS unit tests yet, but it will do soon enough. Thoughts welcome...