Mostly just to remain the same as today's semantics with `*T` and `*mut T`. It doesn't seem like much could go wrong, but too many coercions may push us in the direction of implicit coercions between these two unsafe pointers, which I'd be a little worried about.

I don't have a huge preference one way or another on this (I'm fine amending it into the RFC)