Patent ID: 11875022
Assignee: SNAP INC.
Field: nan (nan)
Classification: CPC nan | IPC G  H

Claim 12:
13. A system that interfaces at least one augmented reality (AR) camera device to at least one Internet of Things (IoT) device, comprising:
pairing means for pairing the at least one AR camera device to the at least one IoT device to establish which actions recognized by the at least one AR camera device may control the at least one IoT device;
an input translator that receives an action identifier from the at least one AR camera device, receives context information relating to the action identifier, the context information including at least one of time of day, weather conditions, Internet download speed, or global positioning system (GPS) data locating the at least one AR camera device, and determines what action the at least one IoT device paired with the at least one AR camera device is to perform in response to the action identifier from the at least one AR camera device, the action identifier including an indication that the at least one AR camera device has recognized a marker in an image obtained by the at least one AR camera device; and
a command generator that generates and sends a command to the at least one IoT device paired with the at least one AR camera device to perform an action based on the context information in response to the action identifier received from the at least one AR camera device when the at least one AR camera device recognizes the marker in the image,
wherein the context information relating to the action identifier from the at least one AR camera device is used to modify the command sent to the at least one IoT device, and the context information is evaluated to determine characteristics of operations of the at least one IoT device,
wherein when the at least one IoT device is an IoT enabled light bulb within a specified geographic radius from the marker in the image or in a room with the marker in the image, the action comprises instructing the IoT enabled light bulb is instructed to change to a specific color based on the context information indicating a user's location as determined from the GPS data, and the time of day, weather conditions, or Internet download speed, and when the at least one IoT device is an IoT enabled smart speaker within a specified geographic radius from the marker in the image or in a room with the marker in the image, the action comprises instructing the IoT enabled smart speaker to play specific music where the specific music is based on the context information.