renamed tokenize fork to prevent import issues
added non-python test to get 100% branch coverage