crawlers are now modular, added config, fewer logging messages, updated readme