Implement multi-threaded HDFS ingress client