A lot of minor changes to crawler_control.c, and maybe wrote over something I shouldn't have in urlinfo.h
Merge branch 'slight_fixes' - undid Cade's change to urlinfo.h (for the time being)

Conflicts:
	urlinfo.h