dont call tokeniter.state() with a cursor