Patent ID: 11954900
Assignee: UNIVERSITY OF CENTRAL FLORIDA RESEARCH FOUNDATION, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for extrinsic visual monitoring of an operational status of a home automation system on a premises, the method comprising the steps of:
a. processing image data representative of nominal operation of the home automation system with a computer processor, the computer processor applying a machine vision process to extrapolate operational indicators from the ambient environment of the premises representative of nominal operation of the home automation system;
b. training an unsupervised machine learning model with the operational indicators to build a model of normalcy and detect expectation violations in the operational pattern of the home automation system;
c. concluding the initial training period when a stopping criterion for the unsupervised machine learning model is met;
d. initiating expectation violation monitoring of the home automation system responsive to the conclusion of the initial training period, a digital camera capturing substantially real-time image data to an image store which is processed by the model to confirm nominal operation and to detect expectation violations;
e. responsive to detecting an expectation violation, generating a contrastive collage comprising images retrieved from the image store, the retrieved images including a first nominal operation image and a second anomaly image of the expectation violation; and
f. transmitting the contrastive collage to an end user of the home automation system wherein the context of the expectation violation is visually conveyed to the end user by the contrastive collage.