Create a branch to work on CONNECTORS-633.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1442812 13f79535-47bb-0310-9956-ffa450edef68
Add partially reworked basic parse state.  Next step: put in the part that autodetects encodings, but defaults to a passed-in value if no encoding preamble.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1442817 13f79535-47bb-0310-9956-ffa450edef68
Add missing default entity

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1442822 13f79535-47bb-0310-9956-ffa450edef68
Rename tag parser, so I can introduce other kinds of parse state objects easily.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1442826 13f79535-47bb-0310-9956-ffa450edef68
More revisions of structure, designed to make a generally useful fuzzy ml parser.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1442918 13f79535-47bb-0310-9956-ffa450edef68
Get the basic structure of the parser right.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443009 13f79535-47bb-0310-9956-ffa450edef68
Add prefixed input stream.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443150 13f79535-47bb-0310-9956-ffa450edef68
Add prefixed reader class

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443199 13f79535-47bb-0310-9956-ffa450edef68
Last stream wrapper

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443211 13f79535-47bb-0310-9956-ffa450edef68
Code for hooking up passthrough into second level CharacterReceiver

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443233 13f79535-47bb-0310-9956-ffa450edef68
Fold pretag parse state into tag parse state.  It makes no sense to try to put xml preamble and entity processing in another module.  The code is not complete yet but the basic idea is fleshed out now.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443307 13f79535-47bb-0310-9956-ffa450edef68
Turn on case sensitivity, and start coding qtag recognition.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443377 13f79535-47bb-0310-9956-ffa450edef68
Finish qtag parsing logic.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443446 13f79535-47bb-0310-9956-ffa450edef68
Add btag parsing

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443764 13f79535-47bb-0310-9956-ffa450edef68
Get the btag parsing roughly where it will be useful.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443786 13f79535-47bb-0310-9956-ffa450edef68
Get the btag parsing roughly where it will be useful.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443789 13f79535-47bb-0310-9956-ffa450edef68
Write character encoding detection logic.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443823 13f79535-47bb-0310-9956-ffa450edef68
Add HTMLParseState, which disables handling of all XML-ish things, and maps html tag names etc to lower case

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443826 13f79535-47bb-0310-9956-ffa450edef68
Revamp the receiver API's; they didn't need to be so clumsy.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443879 13f79535-47bb-0310-9956-ffa450edef68
Complete BOM finite state machine; now we just have to figure out how to handle the streams.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1443900 13f79535-47bb-0310-9956-ffa450edef68