Patent ID: 11886637
Assignee: SONY ADVANCED VISUAL SENSING AG
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A mobile computing device, comprising:
a front sensor assembly;
a rear sensor assembly;
a display; and
a processor assembly monitoring the front sensor assembly and the rear sensor assembly and executing an augmented reality app for rendering an augmented reality scene on the display, wherein the processor assembly tracks a real-world scene and/or a viewpoint of a user with a front event-based vision sensors of the front sensor assembly and/or the rear sensor assembly, and blends an augmented reality scene displayed on the display based on the viewpoint of the user and a scene map of the real-world scene and on the tracking of the one or more event-based vision sensors, processor assembly tracking the real-world scene and/or the viewpoint of the user by determining whether the viewpoint of the user has been displaced based on the front event-based vision sensor and if deemed necessary acquiring information from a front depth sensor and/or a front camera of the front sensor assembly to update the viewpoint;
wherein the processor assembly tracks the real-world scene and/or the viewpoint of the user by determining whether a pose of the mobile computing device has changed and acquiring additional information if deemed necessary; and
wherein the processor assembly further tracks the real-world scene and/or the viewpoint of the user by determining whether a pose of the mobile computing device has changed by acquiring information from an inertial measurement unit and/or a rear depth sensor and/or a rear camera to update a scene map; and
wherein the event-based vision sensors detect OFF-events as discrete decreases in light intensity and/or ON-events as discrete increases in light intensity for pixels of the event-based vision sensors.