What if I added an assert checking the size of SafeHash to make sure it matches? Hopefully it'll just get optimized out if we're good.

Is there a safe way to turn a `&mut u64` into a `&mut SafeHash`?