Add partially reworked basic parse state.  Next step: put in the part that autodetects encodings, but defaults to a passed-in value if no encoding preamble.

git-svn-id: https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-633@1442817 13f79535-47bb-0310-9956-ffa450edef68