Add RobotRule.java => blacklist a product's crawling, or require one
product or require one site.
Modify some detailed  implementation on the anchor filter mechanism, and
add the history management(the initial base)