Patent ID: 11918910
Assignee: nan
Field: Computer technology (Electrical engineering)
Classification: CPC A  G | IPC A  G

Claim 14:
15. A user interaction system, comprising:
a physical model describing a plurality of real objects within a real environment, representing, for each real object, at least a surface, a mass, a motion, acoustic properties, and an interaction with other real objects;
a memory configured to store a dynamic motion state of the plurality of real objects in the real environment extracted from a live action representation of the plurality of real objects;
a user input comprising a change in the dynamic motion state; and
at least one automated processor, configured to
apply the user input to at least one real object in the real environment, to change an interaction of at least one real object with at least one other real object in the real environment with respect to an interaction extrapolated from the dynamic motion state of the plurality of real objects in the real environment and the physical model, absent change in the dynamic motion state due to the user input; and
synthesize a virtual view of the plurality of real objects in the real environment comprising a synthetic interaction of at least two real objects and associated virtual audio, representing the extrapolated interaction of the stored dynamic motion state with the changed interaction of the at least one real object with the at least one other real object in the real environment according to the physical model.