tokenizer changed to lex() and yytext and yylen added
many bugs removed and code generalised by increasing constants
input string read from file