all copied from website, crawler.c starts checking user args
Merge https://github.com/crystaljye/lab4-crawler

gotta get rid of those pesky test files
got rid of shitty test files. init all files for search engine. started checking for user args in crawler.c