remove declaration/assignment of ragel "eof"
added basic tokenizer