updated documentation to reflect code changes
present non-truncating example as main example in _info
document new struct members
Merge branch 'tok-itr' into tok_stream