Update gitignore file
Added userAgent, logging, and disabled loading images
Added utility functions
Added crawl 'site-a'