added bot settings object. added filter function to fix relative links by adding domain to begining of urls... will be brushed up later