Fix warnings on duetto safe casts
Partially revert "Make casts for placement new duetto safe"

It's actually necessary to skip the cast to avoid converting pointer twice.
Otherwise the backend will be confused