included creating a unique key from a hash of attribute values - to support forums that don't have a unique key
working cnet scraper
working fs scraper