added code to include tokens.h
added test code for testing dict functionality with tokenize()
Merge branch 'master' of https://github.com/Berserker88/inr-p1