Implementing Crawler
Abot is a good plugin for managing the crawler part.
We need to know if this can resolved our needs :)