Don't cache pointer or reference types.
Fix bug introduced into unsafe field marshallers