More smart
Merge branch 'master' of https://github.com/korczis/apollo-crawler
Added development and test  groups bundle gems
Merge branch 'master' of https://github.com/korczis/apollo-crawler
Created and engaged guard, you can use rake crawler:guard
Bump to 0.1.10
Fixed shebang line
Bump to 0.1.11
Improved guard file - uses rake crawler:test task for testing
Base fetching functionality moved to BaseFetcher
Added gem 'ffi' - foreign function interface
Refactored Program::run to decrease cyclomatic complexity
Added MongoDB related gems
Added required services to travis configuration file

- MongoDB
- Memcached
- RabbitMQ
Added mongo cache
Basic implementation of MongoCache
Reencode documents to UTF
Preparing for gem release - using MemoryCache and SmartFetcher with 3 sec period
Updated gemspec
Bump to 0.1.12