chore, kick -msse2 check in sxe-compiler and use -fast -march/-mtune instead

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, start work on fastterms(1) utility

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
hygiene, rename isascii() to isntasc() since we're tracking the opposite

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
chore, use separate arrays for non-ascii, alnum and punct bitfields

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
hygiene, use  _mm_xor_si128() instead of `or' for exclusive bitfields

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide naive streak finder ...

just shifting through the alnum and punct bitsets.

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, augment alnum bitfield first before finding streaks

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, take strings that stretch the boundaries of accus into account

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, fix, don't put 0 registers into _tzcnt()

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
chore, always use 32bit registers, stuff them upon classification

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, provide a proper augmenter for puncts

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
hygiene, factor out punct->alnum augmentation

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, also augment by non-ascii characters ...

at the moment we waive the must-be-followed/preceded by ascii requirement.

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
minor, bring back buffered streak printer

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
Merge branch 'tool/fastterms'

* tool/fastterms:
  minor, bring back buffered streak printer
  minor, also augment by non-ascii characters ...
  hygiene, factor out punct->alnum augmentation
  minor, provide a proper augmenter for puncts
  chore, always use 32bit registers, stuff them upon classification
  minor, fix, don't put 0 registers into _tzcnt()
  minor, take strings that stretch the boundaries of accus into account
  minor, augment alnum bitfield first before finding streaks
  minor, provide naive streak finder ...
  hygiene, use  _mm_xor_si128() instead of `or' for exclusive bitfields
  chore, use separate arrays for non-ascii, alnum and punct bitfields
  hygiene, rename isascii() to isntasc() since we're tracking the opposite
  minor, start work on fastterms(1) utility
  chore, kick -msse2 check in sxe-compiler and use -fast -march/-mtune instead
test, provide regressions for basic fastterms(1) functionality

Signed-off-by: Sebastian Freundt <freundt@ga-group.nl>
Merge branch 'tool/fastterms'

* tool/fastterms:
  test, provide regressions for basic fastterms(1) functionality