Don't copy bytes if types are binary comparible