add a reraise backcompat py2/3 func from six
handle exceptions in page getting threads
raise worker exception in main thread immediately
handle unicode error in raw gzip data
more effective archive checking
only do content-type lookup on filename suspect links