Defined how tokens are delimited
Added tests that should fail. Need to write apropos testing mechanism