spoof useragent for more successful tests
link testing pull into function
bugfix use proper test case for test bad links
add cookie processor and host header