Julien Nioche – URL Frontier, an open source API and implementation for crawl frontiers
Channel: Plain Schwarz
Date: 2022-06-15

This talk will present URLFrontier, an API and service implementation of a crawl frontier. After an introduction to how it fits in a distributed crawl architecture, we will go in more details on what the project provides, how it has been used so far and future works.

More: https://pretalx.com/bbuzz22/talk/D3TKUX/

Web: https://2022.berlinbuzzwords.de/
Twitter: https://twitter.com/berlinbuzzwords
LinkedIn: https://www.linkedin.com/showcase/berlin-buzzwords/