update code to use new hadoop api
create custom inputformat to recursively add files
fix pathfilter
bug fix