compat.py: Added a compat module (fixes #28)
__init__.py: Fixed entrys-typo
__init__.py: Improved LogHandler
__init__.py: removed exit_main()
__init__.py: Added improvements suggested by @phihag
__init__.py: Renaming from link to page.
__init__.py: Abstracted config logic
misc: Various changes
crawler.py: New crawling algorithm
crawler.py: Small update for code length