removed the multiple URLs situation from bots, was convoluted, bots structure now returns a hash instead of an array of hashes