doc, elaborate on terms(1) a little more

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
doc, warn again about ignoring the locale settings in Rationale section

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
Merge branch 'doc/general'

* doc/general:
  doc, warn again about ignoring the locale settings in Rationale section
  doc, elaborate on terms(1) a little more
minor, use coroutines to allow reading from stdin in terms(1) tool

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
fix, PEBKAC, determine res value once the state ST_SEEN_ALNUM has been reached

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
fix, PEBKAC, don't base calculation of unproc'd bytes on buffer size

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
hygiene, define coroutines in between main classify1() and classify0() routines and the beef routine (classify_buf())

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
test, add regression tests for terms stdin reader

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
Merge branch 'tool/terms'

* tool/terms:
  test, add regression tests for terms stdin reader
  hygiene, define coroutines in between main classify1() and classify0() routines and the beef routine (classify_buf())
  fix, PEBKAC, don't base calculation of unproc'd bytes on buffer size
  fix, PEBKAC, determine res value once the state ST_SEEN_ALNUM has been reached
  minor, use coroutines to allow reading from stdin in terms(1) tool