System tap for a web crawler