Patent ID: 11954900
Assignee: UNIVERSITY OF CENTRAL FLORIDA RESEARCH FOUNDATION, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 16:
17. A method for extrinsic audible monitoring of an operational status of a home automation system on a premises, the method comprising the steps of:
a. processing audio data with a computer processor, the computer processor applying an auditory scene analysis to extrapolate operational indicators from the ambient environment of the premises representative of nominal operation of the home automation system;
b. training an unsupervised machine learning model with the operational indicators to build a model of normalcy and detect expectation violations in the operational pattern of the home automation system;
c. concluding the initial training period when a stopping criterion for the unsupervised machine learning model is met;
d. initiating expectation violation monitoring of the home automation system responsive to the conclusion of the initial training period, a digital camera having a digital microphone capturing substantially real-time audio data to an audio store which is processed by the model to confirm nominal operation and to detect expectation violations;
e. responsive to detecting an expectation violation, generating a contrastive collage comprising images retrieved from an image store, the retrieved images including a first nominal operation image and a second anomaly image captured concurrently with the expectation violation identified by the real-time audio data; and
f. transmitting the contrastive collage to an end user of the home automation system wherein the context of the audibly-detected expectation violation is visually conveyed to the end user by the contrastive collage.