HDFS endpoint collecting and aggregating data flows