courlan (pypi): Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters.
Keywords: cleaner|crawler|preprocessing|url-parsing|url-manipulation|urls|validation|webcrawling|domain|tld|url