Prevent overwriting comparison headers

Make sure our headers stay, otherwise the pointer we use for fast
comparison will point to a piece of memory that might get overwritten
with something else :/