A security system having audio analytics comprising: network interface circuitry to receive an audio input stream via a microphone (104a, 104b); a processor coupled to the network interface circuitry; one or more memory devices coupled to the processor, the one or more memory devices including instructions, which when executed by the processor cause the system to: divide the audio input stream into audio segments; filter high energy audio segments from the audio segments; determine that a first high energy audio segment includes speech, and determine if the speech is recognized as the speech of users of the system; determine that a second high energy audio segment does not include the speech, and classify the second high energy audio segment as an interesting sound or an uninteresting sound; and determine whether to turn video on based on classification of the second high energy audio segment as the interesting sound, speech recognition of the speech as the speech of the users of the system, and contextual data, wherein if the classification of the second high energy audio segment comprises the interesting sound, in the first high energy audio segment the speech is recognized as the speech of the users of the system, and the contextual data indicates a normal user behavior pattern, the instructions, which when executed by the processor further cause the system to turn the video off or keep the video off to maintain privacy of the user. network interface circuitry to receive an audio input stream via a microphone (104a, 104b); a processor coupled to the network interface circuitry; one or more memory devices coupled to the processor, the one or more memory devices including instructions, which when executed by the processor cause the system to: divide the audio input stream into audio segments; filter high energy audio segments from the audio segments; determine that a first high energy audio segment includes speech, and determine if the speech is recognized as the speech of users of the system; determine that a second high energy audio segment does not include the speech, and classify the second high energy audio segment as an interesting sound or an uninteresting sound; and determine whether to turn video on based on classification of the second high energy audio segment as the interesting sound, speech recognition of the speech as the speech of the users of the system, and contextual data, wherein if the classification of the second high energy audio segment comprises the interesting sound, in the first high energy audio segment the speech is recognized as the speech of the users of the system, and the contextual data indicates a normal user behavior pattern, the instructions, which when executed by the processor further cause the system to turn the video off or keep the video off to maintain privacy of the user. divide the audio input stream into audio segments; filter high energy audio segments from the audio segments; determine that a first high energy audio segment includes speech, and determine if the speech is recognized as the speech of users of the system; determine that a second high energy audio segment does not include the speech, and classify the second high energy audio segment as an interesting sound or an uninteresting sound; and determine whether to turn video on based on classification of the second high energy audio segment as the interesting sound, speech recognition of the speech as the speech of the users of the system, and contextual data, wherein if the classification of the second high energy audio segment comprises the interesting sound, in the first high energy audio segment the speech is recognized as the speech of the users of the system, and the contextual data indicates a normal user behavior pattern, the instructions, which when executed by the processor further cause the system to turn the video off or keep the video off to maintain privacy of the user.