Fixing some errors in the http spidering module