Reduce memory usage
Add more tests
Refactor crawler
Improve test readability
Update docs