Minor refactorings to clean up xxh64 code

This also seems to make the benchmarks run a little faster:

  before  10,605 ± 134 MB/s
  after   11,131 ± 148 MB/s