test, provide some basic regressions for terms binary

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, register default range properly and kick . and : chars from default set

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, interpret octal escapes (\177 et al) in -c|--class option to terms(1)

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
Merge branch 'test/terms'

* test/terms:
  minor, interpret octal escapes (\177 et al) in -c|--class option to terms(1)
  minor, register default range properly and kick . and : chars from default set
  test, provide some basic regressions for terms binary
chore, check for tokyocabinet

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide a quick term->corpus-id map in libglod.a via glkv.[ch]

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide command line tool to add terms to the corpus, tcvec(1)

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, allow to read/use custom corpus file via --corpus|-f (tcv)

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
hygiene, rename glkv -> corpus

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
hygiene, rename tcvec -> tf

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide --add|-a mode to tf binary, to extend the corpus whilst counting frequencies

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, actually output the term frequency

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide --dense to tf(1) for a dense binary blob representation of the tf vector

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
Merge branch 'feat/tf'

* feat/tf:
  minor, provide --dense to tf(1) for a dense binary blob representation of the tf vector
  minor, actually output the term frequency
  minor, provide --add|-a mode to tf binary, to extend the corpus whilst counting frequencies
  hygiene, rename tcvec -> tf
  hygiene, rename glkv -> corpus
  minor, allow to read/use custom corpus file via --corpus|-f (tcv)
  minor, provide command line tool to add terms to the corpus, tcvec(1)
  minor, provide a quick term->corpus-id map in libglod.a via glkv.[ch]
  chore, check for tokyocabinet