Always compile xxhash with optimizations (debug only)

Makes the debug build faster, was about 15% of profile in some cases (and now under 1%.)

No good reason to debug xxhash.

-[Unknown]