modify get_back_links to immediately push urls from a google blink req. to the requesting url's inlinks
get_back_links also adds new links to linksfound and urltable
modify link_inlinks to check if the inlink exists first before linking since many inlinks are now created in get_backlinks
add some .txt files to .gitignore
get_in_links2 now checks domain max first
start writing print_domain_to_file function -> not finished
modify get_back_links to immediately push urls from a google blink req. to the requesting url's inlinks
get_back_links also adds new links to linksfound and urltable
modify link_inlinks to check if the inlink exists first before linking since many inlinks are now created in get_backlinks
add some .txt files to .gitignore
Merge branch 'domain_check' into algorithm
print_domains_to_file() in domaininfo.c incomplete (commented out) and not yet used
Conflicts:
	crawler_control.c