cantino/huginn — pull request #234 by afro88 (2014-04-19 02:12:35+00:00)
Title: Website agent url arrays

Hi,

I've modified WebsiteAgent to accept an array of URLs to be scraped. This is useful when you want to scrape a number of pages on the same site, that all have the same layout and items to extract.

For example, each chart page on iTunes.

I found I had to create lots of nearly identical agents for my use case, hence the addition.

Cheers