A script to process all of the crawler data