finish the lexical analysis post and create the skeleton for algoirthms and tools