Patent ID: 11972609
Assignee: QUANTUM INTERFACE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 0:
1. An apparatus comprising:
an electronic device including a display device, one or more input devices, one or more output devices, a camera, a sensor capable of sensing blob data associated with touching the sensor, and a processing unit;
the camera configured to capture an image;
the sensor configured to detect blob data associated with a touch on the sensor;
the processing unit configured to:
receive the captured image;
if the touch exceed a threshold value associated with the sensor, receive the blob data, the blob data including a pressure distribution of the touch, a centroid of the pressure distribution, and a direction associated with the pressure distribution;
in response to the touch:
identify objects, object features, object characteristics, object properties, object attributes, image features, image characteristics, image properties, and image attributes associated with the capture image;
generate an virtual reality (VR), augmented reality (AR), mixed reality (MR), cross reality (XR), or cinematic reality (CR) construct including virtual objects corresponding to the identified objects, object features, object characteristics, object properties, object attributes, image features, image characteristics, image properties, and image attributes;
populate the construct with the generated virtual objects, the virtual objects located in the construct at locations corresponding to locations of the identified objects, object features, object characteristic, object properties, object attributes, and image features, image characteristic, image properties, and image attributes in the captured image and repositioning none, one, or some of the virtual objects to improve virtual object selection,
display on the display device the captured image and the construct,
determine a location of the touch on the sensor,
generate a ray from the location to a corresponding location on the captured image, the ray including an offset based on the location so that the objects, object features, object characteristic, object properties, object attributes, image features, image characteristics, image properties, and image attributes within the capture image are not obscured,
display on the display device the ray emanating from the location to the corresponding location on the captured image, and
indicate one or more virtual objects in the construct corresponding to one or more objects, object features, object characteristic, object properties, object attributes, image features, image characteristics, image properties, and image attributes associated with the captured image contacted by a distal end of the ray or closest to the distal end of the ray;
receive a change in the blob data from the sensor, the change in the blob data comprising a changed pressure distribution, a changed centroid of the changed pressure distribution, a changed direction of the changed pressure distribution, a velocity of the changed pressure distribution, and an acceleration of the changed pressure distribution; and
in response to the change in the blob data:
select a particular virtual object from the one or more indicated virtual objects based on the change in the blob data, and
 activate the particular virtual object.