Patent ID: 11961178
Assignee: nan
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H  A | IPC A  G  H

Claim 0:
1. A method for reducing the effects of latency in an extended reality (XR) experience, the method comprising:
i) distinguishing between two types of imagery to be rendered;
ii) differentially computing and communicating data, dependent upon the imagery type, such that when the imagery is of:
a) a first type of the two types of imagery, which is background or distant imagery, it is rendered in a known frame of reference by a server and sent to a user's device from the server where it is transformed to a second frame of reference by the user's device and re-rendered;
b) a second type of the two types of imagery, which is fast-moving imagery, fast-changing imagery, or imagery very close to a user's point of view relative to the first type imagery, it is rendered locally by the user's device;

iii) compositing the first type imagery and the second type imagery, by the user device;
wherein:
i) a graphic processing unit (GPU) at the server is sent rendering commands, from the server, to generate an image-frame;
ii) the GPU at the server is sent commands, from the server, to embed metadata providing information that facilitates the association of image-frame-specific information with an image-frame rendered locally by the user's device;
iii) a user's GPU extracts the metadata to facilitate recompositing of the image by the user's device; and
wherein the imagery of the first type is stored on the user device, such that the frame of reference is consistent over time, with each image element being sent from the server to the user device where it is transformed from its own frame of reference to the storage frame and it updates the stored imagery for later transformation into camera space.