added an unit test that triggers skipped tokens.