xml import keeps failing to read text nodes on opening tags... resulting in missing img urls.
browser aims to limit memory consumption and disk access, crawler initializes better frontier, indicates discovery of images previously known from other sources.
page rank test module
crawler can now be reused to continue a once commenced search without going through recently visited blogs again.