Patent ID: 11921988
Assignee: GOOGLE LLC
Field: Audio-visual technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 10:
11. A computing system, comprising:
one or more processors; and
one or more tangible, non-transitory computer readable media storing computer-readable instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising:
receiving image data for an image captured by a camera of a computing device of a user;
determining, based on the image data and by processing the image data with an object recognizer to generate identified object data, that the image depicts a smart device, wherein the object recognizer comprises a coarse classifier that determines whether a pixel data set comprises an object in one or more particular smart device classes based on one or more image features;
in response to determining that the image depicts a smart device of the one or more particular smart device classes, registering the computing device with the smart device, wherein registering the computing device comprises generating and transmitting a registration file associated with the computing device, wherein the registration file comprises device identification data and interface controls identification data, and wherein the interface controls identification data is generated based on a determined class of smart devices associated with the smart device;
receiving a user interaction to control the smart device from the computing device; and
controlling, based on the registration file, the smart device based on the user interaction to control the smart device.