cgiffard/node-simplecrawler — pull request #85 by huijar (2014-07-01 06:54:02+00:00)
Title: Parse options for skipping HTML comments & script tags

Some pages contain junk like

This leads to a problem where the <img> tag in the script (which itself is in a comment) gets parsed, but returns only '\' (%5C) because of the escaped quotation mark.

I propose adding parseHTMLComments and parseScriptTags options with non-breaking defaults (ie. true) to skip HTML comments and script tags if wanted.