improved logging message
rewrote crawling algorithm, improved logging messages