Remove some more hacks now that DataLayout knows about fat pointers.