Minor refactorings to clean up xxh64 code

This also seems to make the benchmarks run a little faster:

```
before  10,605 ± 134 MB/s
after   11,131 ± 148 MB/s
```