added tokens.md
Added lexer file for Flex