Remove intellij folder and update to a better gitignore.
Remove intellij folder, project file and update to a better gitignore.
Add lombok
Refactor so everything uses lombok log4j2 rather than doing it manually.
Change so only once instance of MongoClient is used
Only store whitelisted queues.
Save the html for each crawl in its own document, it was causing mongo to go over its document size limit.
Implement Bloom Filter
Rename domains settings
Refactor
Refactor
Update pom to produce shaded jar
Uncomment debug file
Remove already crawled logging message, it spams the logs.
Refactor
Add javadocs
Add name for shaded jar