Initial checkin with token and listlexer
Lexer base class
Test for Pattern 2 LL(1) Lexer.
Fixed!

Fixed whitespace cases.
The correct text is put into the token now.
Name returns a token.
Added decode as an alias for to_s
Made #tname a class method.

Also removed redundant #initialize.
tname is now called via class.
Added LL(1) Parser fir lists
Used renamed ll1parser.rb.
Used renamed ll1parser.rb
Added '=' recognition
Added LL(k) list parser
Added explanation of test.
Corrected error message.
Added Java code from book
Backtracking Parser for list / assign
Initial state for memoising parser
Removed debug code from expected exceptions
Added memoisation to backtracking parser
Moved on to ASTs