Response handler can derive the URL from within the response itself
Tidying up thru using better destructuring
Move the crawled? check up a level
Do away with base-url state