parse HTML, find URLs, use 2 queues, try Lucene