fix tests for removal of COMMENT token and change to AddLine
add test-all target to run all go tests and C runtime test
cleanup multi-token scanning