Revamp of tokenizer tests (part 2)

The harness batch file now does file comparisons with the reference
build

This CL obsoletes most pragma tests now, which we remove next.
Revamp of tokenizer tests (part 3)

Now removing the dead code.
adding Insert structure

A better way to handle insert or replacements. Each src token can have
an insert pointer which contains a vector of inserted tokens.

This allows to have a clean way to write the output without having to
renumber the main src vector and associated dbs. This is also moves us
closer to remove the test mode.