DigitalPebble/storm-crawler — pull request #42 by jnioche (2014-12-18 12:09:32+00:00)
Title: Sitemaps parser

See #38

This adds a SiteMapParserBolt and a test class. It also reorganizes the test resources and makes the ParsingTester more generic.

As discussed, this Bolt uses a non-default stream 'status' to output the newly discovered URLs and the default stream for documents that are not marked as being sitemaps.

Could you please review this? Thanks!