Patent ID: 11948260
Assignee: LUCASFILM ENTERTAINMENT COMPANY LTD
Field: Computer technology (Electrical engineering)
Classification: CPC G  A  H | IPC A  G  H

Claim 6:
7. An immersive content presentation system comprising:
one or more processors; and
one or more memory devices comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving a motion or position of a first real-world performer in a first real-world environment;
moving or positioning a virtual representation of the first real-world performer in a 3-D virtual environment based on the motion or position of the first real-world performer, wherein the 3-D virtual environment includes models or volumes that correspond to physical objects in a second real-world environment;
rendering a 2-D video stream of the virtual representation of the first real-world performer in the 3-D virtual environment, including:
rendering images in the 2-D video stream without images of the models or volumes that correspond to the physical objects in the second real-world environment; and
generating cutouts in images of the virtual representation of the first real-world performer in the 2-D video stream when the virtual representation of the first real-world performer is behind the models or volumes that correspond to the physical objects in the second real-world environment; and

causing a real-time video stream to be visible on a display device of a handheld or wearable device, wherein:
the handheld or wearable device captures the real-time view of a second real-world environment comprising view of a second real-world performer;
the real-time video stream comprises the 2-D video stream of the virtual representation of the first real-world performer composited with the real-time view of the second real-world environment comprising a view of the second real-world performer; and
the motion or position of the first real-world performer in the first real-world environment moves or positions the virtual representation of the first real-world performer in the 3-D virtual environment in real time as the 2-D video stream is composited with the real-time view of the second real-world environment such that the second real-world performer and the virtual representation of the first real-world performer appear to interact in real time with each other when viewed on the display device of the handheld or wearable device.