Initial crawler.
Refactor: Rename URL to URI most places.
Make login work again, add some comments.
Add tests for crawler (forgot earlier).
Make crawler handle relative paths + some cleanup.
Refactor tests.
JSHint cleanup.
Refactor tests.
JSHint cleanup.
Fix bin to send context object as argument, instead of several arguments.
Refactor: Rename and move functions.
Update test cases.
Update test cases.
Refactors crawler. Should be further refactored.
Update and add tests.
Remove unused var.
Add TODOs
Small refactorings, adding TODOs.
Optimizing loops.
Subdomain exclusion.