web spider,based on spiderman(you can find it by seaching in github,laiweiwei,the author of the spider),you can use spiderson to spider web infomation and store it in database ,and the attachments,such as pictures will also be download