automating spiders -- compiling results into master json