Add request to response structure.

A request is now used to start a crawl. The resulting response
contains a pointer to the initial request. These changes will be
helpful when adding concurrency.
Fix broken tests.
Add concurrent requests.