Break out the queuing of the crawl URIs into its own private method.