Web crawler updated to skip paths (ExcludePathPatterns option)

Option ```ExcludePathPatterns``` allows users to specify which paths should be excluded from the crawl (and which forms to ignore) by passing a list of patterns (only allows '*' wildcards).