apache/incubator-spark — pull request #531 by tsdeng (2014-02-03 18:32:51+00:00)
Title: Hdfs read, write metrics for executor

Hi,
I'm this pull request dumps BytesRead and BytesWritten for FileSystem. Could someone please review this?
One question is: Using following code I found the sum of hdfsBytes read from executors could be much bigger than the data's total size. ~200GB(hdfsRead) vs 70GB(size of the dataInput). What could be the cause?