A method for speech recognition implemented as a plurality of computer processes functioning in a computer processor, the method comprising: in one or more computer processes: processing an input speech utterance to produce a sequence of representative speech vectors; and performing a single time-synchronous speech recognition pass using a decoding search to determine a recognition output corresponding to the speech input, the decoding search including: i. for each speech vector before a first threshold number of speech vectors, estimating a feature transform based on a conventional online CMN and CVN feature normalization transform; ii. for each speech vector after the first threshold number of speech vectors, estimating the feature transform based on the preceding speech vectors in the utterance and partial decoding results of the decoding search,; iii. adjusting a current speech vector based on the feature transform, and iv. using the adjusted current speech vector in a current frame of the decoding search, wherein for each speech vector after the first threshold number of speech vectors and before a second threshold number of speech vectors, the feature transform is interpolated between the transform based on conventional online CMN and CVN. feature normalization and the transform based on the preceding speech vectors in the utterance and partial decoding results of the decoding search. in one or more computer processes: processing an input speech utterance to produce a sequence of representative speech vectors; and performing a single time-synchronous speech recognition pass using a decoding search to determine a recognition output corresponding to the speech input, the decoding search including: i. for each speech vector before a first threshold number of speech vectors, estimating a feature transform based on a conventional online CMN and CVN feature normalization transform; ii. for each speech vector after the first threshold number of speech vectors, estimating the feature transform based on the preceding speech vectors in the utterance and partial decoding results of the decoding search,; iii. adjusting a current speech vector based on the feature transform, and iv. using the adjusted current speech vector in a current frame of the decoding search, processing an input speech utterance to produce a sequence of representative speech vectors; and performing a single time-synchronous speech recognition pass using a decoding search to determine a recognition output corresponding to the speech input, the decoding search including: i. for each speech vector before a first threshold number of speech vectors, estimating a feature transform based on a conventional online CMN and CVN feature normalization transform; ii. for each speech vector after the first threshold number of speech vectors, estimating the feature transform based on the preceding speech vectors in the utterance and partial decoding results of the decoding search,; iii. adjusting a current speech vector based on the feature transform, and iv. using the adjusted current speech vector in a current frame of the decoding search, i. for each speech vector before a first threshold number of speech vectors, estimating a feature transform based on a conventional online CMN and CVN feature normalization transform; ii. for each speech vector after the first threshold number of speech vectors, estimating the feature transform based on the preceding speech vectors in the utterance and partial decoding results of the decoding search,; iii. adjusting a current speech vector based on the feature transform, and iv. using the adjusted current speech vector in a current frame of the decoding search, wherein for each speech vector after the first threshold number of speech vectors and before a second threshold number of speech vectors, the feature transform is interpolated between the transform based on conventional online CMN and CVN. feature normalization and the transform based on the preceding speech vectors in the utterance and partial decoding results of the decoding search.