Crawler Detection: A Bayesian Approach
an investigation of web crawler behavior : characterization and metrics .