A speech detection system comprising: a memory to store received audio input; and a processor coupled to the memory, the processor to: generate, via acoustic scoring of an acoustic model based on the received audio input, a plurality of probability scores each for a corresponding audio unit; update a speech pattern model based on at least some of the probability scores to generate a score for each state of the speech pattern model, wherein the speech pattern model comprises a first non-speech state comprising a plurality of self loops each associated with a non-speech probability score of the probability scores, a plurality of speech states following the first non-speech state, and a second non-speech state following the speech states, wherein the speech states comprise a first speech state following the first non-speech state and a second speech state following the first speech state and preceding the second non-speech state; determine whether the received audio input comprises speech based on a comparison of a first score of the first non-speech state and a second score of the second speech state; and provide a speech detection indicator when the received audio input comprises speech. a memory to store received audio input; and a processor coupled to the memory, the processor to: generate, via acoustic scoring of an acoustic model based on the received audio input, a plurality of probability scores each for a corresponding audio unit; update a speech pattern model based on at least some of the probability scores to generate a score for each state of the speech pattern model, wherein the speech pattern model comprises a first non-speech state comprising a plurality of self loops each associated with a non-speech probability score of the probability scores, a plurality of speech states following the first non-speech state, and a second non-speech state following the speech states, wherein the speech states comprise a first speech state following the first non-speech state and a second speech state following the first speech state and preceding the second non-speech state; determine whether the received audio input comprises speech based on a comparison of a first score of the first non-speech state and a second score of the second speech state; and provide a speech detection indicator when the received audio input comprises speech. generate, via acoustic scoring of an acoustic model based on the received audio input, a plurality of probability scores each for a corresponding audio unit; update a speech pattern model based on at least some of the probability scores to generate a score for each state of the speech pattern model, wherein the speech pattern model comprises a first non-speech state comprising a plurality of self loops each associated with a non-speech probability score of the probability scores, a plurality of speech states following the first non-speech state, and a second non-speech state following the speech states, wherein the speech states comprise a first speech state following the first non-speech state and a second speech state following the first speech state and preceding the second non-speech state; determine whether the received audio input comprises speech based on a comparison of a first score of the first non-speech state and a second score of the second speech state; and provide a speech detection indicator when the received audio input comprises speech.