twitter/hraven — pull request #103 by angadsingh (2014-06-29 11:19:43+00:00)
Title: glob list instead of simple hdfs list and pattern support for input

Right now hraven accepts a simple hdfs path as input folder and will fetch all job history + conf files underneath it. This pull requests add support for specifying a pattern with wildcards (*) and using hdfs api's globStatus method to list files instead of hraven's recursive listFiles method. This way one can easily shard hraven's job to different years/months/days.