Fixed potential crash during encoding
Fixed test failures
Bump to 0.1.13
Do not visited URLs twice (not persisten implementation)
Added em-http Gem
Added eventmachine
Added typhoeus

Like a modern code version of the mythical beast with 100 serpent heads, Typhoeus runs HTTP requests in parallel while cleanly encapsulating handling logic.
Improved test

Crawler tests in silent mode
Enabled generator test again
Create TODO.md
Update TODO.md
Update README.md
Added em-synchrony
Merge branch 'master' of https://github.com/korczis/apollo-crawler
More customizable

You can override:
- host
- port
- database name
- collection name
Basic sculpture of at_exit handler - will be used for cleaning caches, etc, needs some preparation
Switched to mongodb cache for a while
More modular  creating user program folder structure (~/.apollo-crawler)
Bit cleaned at_exit, at_exit_handler and request_exit
Cosmetics in loading config file - more parametrized
Cosmetics