Use the same IdentityMap when loading associations