Patent ID: 11972609
Assignee: QUANTUM INTERFACE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 10:
11. A method implemented on an apparatus comprising an electronic device including a display device, a camera, a sensor capable of sensing blob data associated with touching the sensor, one or more input devices, one or more output devices, and a processing unit, the method comprising:
capturing, via the camera, an image;
detecting, via the sensor, a touch on the sensor;
receiving, via the processing unit, the captured image from the sensor by the;
if the touch exceed a threshold value associated with the sensor, receiving blob data corresponding to the touch, the blob data including a pressure distribution of the touch, a centroid of the pressure distribution, and a direction of the pressure distribution;
in response to the touch:
identifying, via the processing unit, objects, object features, object characteristics, object properties, object attributes, image features, image characteristics, image properties, and image attributes associated with the capture image;
generating, via the processing unit, an virtual reality (VR), augmented reality (AR), mixed reality (MR), cross reality (XR), or cinematic reality (CR) construct including virtual objects corresponding to the identified objects, object features, object characteristics, object properties, object attributes, image features, image characteristics, image properties, and image attributes;
populating, via the processing unit, the construct with the generated virtual objects, the virtual objects located in the construct at locations corresponding to locations of the identified objects, object features, object characteristic, object properties, object attributes, and image features, image characteristic, image properties, and image attributes in the captured image and repositioning none, one, or some of the virtual objects to improve virtual object selection, displaying, via the processing unit on the display device, the captured image and the construct,
determining, via the processing unit, a location of the touch on the sensor, generating, via the processing unit, a ray from the location to a corresponding location on the captured image, the ray including an offset based on the location so that the objects, object features, object characteristic, object properties, object attributes, image features, image characteristics, image properties, and image attributes within the capture image are not obscured,
displaying, via the processing unit on the display device, the ray emanating from the location to the corresponding location on the captured image,
indicating, via the processing unit on the display device, one or more virtual objects in the construct corresponding to one or more objects, object features, object characteristic, object properties, object attributes, image features, image characteristics, image properties, and image attributes associated within the captured image contacted by a distal end of the ray or closest to the distal end of the ray;
receiving, via the processing unit from the sensor, a change in the blob data, the change in the blob data comprising a changed pressure distribution, a changed centroid of the changed pressure distribution, a changed direction of the changed pressure distribution, a velocity of the changed pressure distribution, and an acceleration of the changed pressure distribution; and
in response to the change in the blob data:
selecting, via the processing unit, a particular virtual object from the one or more indicated virtual objects based on the change in the blob data, and
activate, via the processing unit, the particular virtual object.