A method of speaker verification, the method comprising: creating a common speaker's library including multiple recordings of conversations between a known speaker and another speaker, the known speaker speaking in each recording of the multiple recordings; employing the common speaker's library to locate speech of the known speaker by segmenting each recording of the multiple recordings into segmented audio files based on acoustic differences; accumulating speech of the known speaker located from the multiple recordings to create a known speaker voiceprint (124; 464; 604) for the known speaker; identifying a target speaker's speech, using the known speaker voiceprint (124; 464; 604) to exclude speech segments of the known speaker's speech from a single-channel audio recording (108; 202; 302; 456; 602) of a conversation between the known speaker and the target speaker, the single-channel audio recording (108; 202; 302; 456; 602) including the target speaker's speech and the known speaker's speech, the known speaker voiceprint (124; 464; 604) corresponding to the known speaker, wherein the target speaker and the known speaker are different speakers; and verifying the target speaker based on a target speaker voiceprint, the verifying including segmenting the single-channel audio recording (108; 202; 302; 456; 602) into at least two audio segments, verifying each audio segment of the at least two audio segments against both the known speaker voiceprint (124; 464; 604) and the target speaker voiceprint, and discarding each audio segment of the at least two audio segments that includes speech that matches the known speaker voiceprint (124; 464; 604) above a threshold, wherein the target speaker is verified based on an audio segment, among remaining audio segments, which yields a highest score for the target speaker voiceprint. creating a common speaker's library including multiple recordings of conversations between a known speaker and another speaker, the known speaker speaking in each recording of the multiple recordings; employing the common speaker's library to locate speech of the known speaker by segmenting each recording of the multiple recordings into segmented audio files based on acoustic differences; accumulating speech of the known speaker located from the multiple recordings to create a known speaker voiceprint (124; 464; 604) for the known speaker; identifying a target speaker's speech, using the known speaker voiceprint (124; 464; 604) to exclude speech segments of the known speaker's speech from a single-channel audio recording (108; 202; 302; 456; 602) of a conversation between the known speaker and the target speaker, the single-channel audio recording (108; 202; 302; 456; 602) including the target speaker's speech and the known speaker's speech, the known speaker voiceprint (124; 464; 604) corresponding to the known speaker, wherein the target speaker and the known speaker are different speakers; and verifying the target speaker based on a target speaker voiceprint, the verifying including segmenting the single-channel audio recording (108; 202; 302; 456; 602) into at least two audio segments, verifying each audio segment of the at least two audio segments against both the known speaker voiceprint (124; 464; 604) and the target speaker voiceprint, and discarding each audio segment of the at least two audio segments that includes speech that matches the known speaker voiceprint (124; 464; 604) above a threshold, wherein the target speaker is verified based on an audio segment, among remaining audio segments, which yields a highest score for the target speaker voiceprint.