lexan: add ability to tag and end of input marker to token ranges

Signed-off-by: Peter Williams <pwil3058@gmail.com>
dunnart: modify algorithm to utilize append end of input token

Signed-off-by: Peter Williams <pwil3058@gmail.com>
dunnart: fix examples' make files for new location of files

Signed-off-by: Peter Williams <pwil3058@gmail.com>
dunnart: modify error recovery to gobble input looking for viable state

Signed-off-by: Peter Williams <pwil3058@gmail.com>
dunnart: tidy up (a little bit)

Signed-off-by: Peter Williams <pwil3058@gmail.com>