Patent ID: 7536445
Filing Date: 2009-05-19
Classification: G06F

Abstract:
1. A server, comprising: a proxy function unit for relaying data exchanged between a web sewer site on a network and a web-crawling robot collecting contents by accessing the site; a link deriving unit for expanding a link if the link is included in a database that associates and registers location information of the collected contents and acquiring information on a user agent corresponding to content of a link destination when said proxy function unit receives a response from the site to a content retrieval request issued from said web-crawling robot to said site, wherein the link deriving unit expands the link by acquiring from the database a list of the user agent information of each user agent corresponding to the link; and a user agent information editing unit, wherein the user agent information editing unit is used if a link destination of the link included in the response has dynamic content that differs according to a type of user agent which is an access source, and wherein the user agent information editing unit is further used for converting user agent information included in the content retrieval request to user agent corresponding to said content of the link destination to disguise the content retrieval request to be issued from the user agent, when said proxy function unit receives the content retrieval request from said web-crawling robot issued based on derived links.