added agents
made git ignore *.log files
added `net.cgrand.enlive-html` and related dependencies
made git ignore `target/`
added dependency jar (just in case)
added url-normalizer dependency
added more on agents and the crawler