Experimental code to spider a site as a smoke test.