A pattern tree-based approach to learning URL normalization rules
Detecting near-duplicates for web crawling