17: complete Shell grammar at once
17: add more debugging for lexer
17: exit TOKEN state once WORD is delimited
17: ignore line-joining in INITIAL state
17: do not break operators with line-joining
17: use custom routine instead of yymore()
17: collect trailing token parts
17: simplify token recognition
17: add newline to token delimiters
17: join lines in both INITIAL and TOKEN states
17: check multiple line-joining
17: handle leading newlines separately
17: clean sources and binaries separately
17: do not ignore NEWLINE once token delimited
17: delimit last token with EOF