initial import of glang husk

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
trial, output 2grams along with hashes and occurrence counts in glang(1)

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide a 3gram version for glang(1)

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
chore, rename glang -> glid

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, unify 2grams and 3grams classifier routine, use separate storage though

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, unify storages as well

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
fix, PEBKAC, only write  into the reserved ngram vector slots

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
chore, turn glid into umbrella, provide show command for explicit relative n-gram freqs

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, also calc frequencies of 4-grams in glid show

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, only show the 95% quantile

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, rinse results and buffers between files

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide configurable confidence

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
trial, another attempt with separate storage again

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
chore, make 4-grams optional, use -DWITH_4GRAMS

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
chore, cut down gram vectors to 1 entry

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, avoid div-by-zero in pr_rfreq()

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
chore, kick #if0'd non-working code

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
Merge branch 'tool/glid'

* tool/glid:
  chore, kick #if0'd non-working code
  minor, avoid div-by-zero in pr_rfreq()
  chore, cut down gram vectors to 1 entry
  chore, make 4-grams optional, use -DWITH_4GRAMS
  trial, another attempt with separate storage again
  minor, provide configurable confidence
  minor, rinse results and buffers between files
  minor, only show the 95% quantile
  minor, also calc frequencies of 4-grams in glid show
  chore, turn glid into umbrella, provide show command for explicit relative n-gram freqs
  fix, PEBKAC, only write  into the reserved ngram vector slots
  minor, unify storages as well
  minor, unify 2grams and 3grams classifier routine, use separate storage though
  chore, rename glang -> glid
  minor, provide a 3gram version for glang(1)
  trial, output 2grams along with hashes and occurrence counts in glang(1)
  initial import of glang husk