updated script to prevent blocking and collect metadata. Currently won't generate a fresh list of cities to crawl - revert this by uncommenting line in 'main' section