Only do *&ex -> ex optimisation if there is no type punning involved

https://issues.dlang.org/show_bug.cgi?id=12900