update the spider
correctly check file extensions
don't display libxml errors
start logging accessibility errors
enforce encoding, do not use cdata and hide comments