added all available data
hash exclusion seems to be working
working batch 2