Further converted lexer to C

Signed-off-by: Shahbaz Youssefi <ShabbyX@gmail.com>
tokens reader now stores dfas in shList

Signed-off-by: Shahbaz Youssefi <ShabbyX@gmail.com>
token reader now uses shVector for NFA stack

Signed-off-by: Shahbaz Youssefi <ShabbyX@gmail.com>