Remove aliasing detection.

It cannot be made foolproof, so I don't want to have a false sense of security
(essentially what eigen3 does as well).