not track zip, dat and dotfiles
implemented new mapreduce workflow. to be tested