Rename TokenStream<> to Tokenizer<>

git-svn-id: svn://svn.code.sf.net/p/open-axiom/code/trunk@3089 f499efd5-9937-0410-b36a-d3739c31ded8
Add Lisp punctuators to the generic lexer.

git-svn-id: svn://svn.code.sf.net/p/open-axiom/code/trunk@3090 f499efd5-9937-0410-b36a-d3739c31ded8
Rename BasicString to InternedString

git-svn-id: svn://svn.code.sf.net/p/open-axiom/code/trunk@3091 f499efd5-9937-0410-b36a-d3739c31ded8
Tidy all-boot dependencies.

git-svn-id: svn://svn.code.sf.net/p/open-axiom/code/trunk@3092 f499efd5-9937-0410-b36a-d3739c31ded8
Tidy value representation.

git-svn-id: svn://svn.code.sf.net/p/open-axiom/code/trunk@3093 f499efd5-9937-0410-b36a-d3739c31ded8
Add more functionalities to the VM.

git-svn-id: svn://svn.code.sf.net/p/open-axiom/code/trunk@3094 f499efd5-9937-0410-b36a-d3739c31ded8
Fix QT5 toAscii() compatibility issue.

git-svn-id: svn://svn.code.sf.net/p/open-axiom/code/trunk@3095 f499efd5-9937-0410-b36a-d3739c31ded8