Add web page information required by spider
Modify allowable domain to restrict crawling