Patent ID: 11918910
Assignee: nan
Field: Computer technology (Electrical engineering)
Classification: CPC A  G | IPC A  G

Claim 19:
20. A user interactive method, comprising:
storing a physical model describing a plurality of real objects within a real environment, representing, for each real object, at least a surface, a mass, a motion, acoustic emissions and interaction with other real objects;
storing a dynamic state of the plurality of real objects in the real environment extracted from a live action video of the plurality of real objects;
receiving a user input comprising quantitative values of orthogonal axes of linear and rotational movement;
applying the user input to at least one real object in the real environment and constrained by the physical model, to change an interaction of the at least one real object with at least one other real object in the real environment, wherein the changed interaction differs from an interaction extrapolated from the stored dynamic state of the plurality of real objects in the real environment and constrained by the physical model; and
synthesizing a virtual view of the plurality of real objects in the real environment and virtual acoustic emissions comprising an extrapolation of the stored dynamic state modified to comprise the changed interaction.