Added virtualhost crawler using BING. Seems to work but hangs sometimes (investigate this!)
Http crawler needs a couple of fixes before it works