A method comprising the following steps arranged for execution by a processing device: receiving, through a plurality of channels, audio data, wherein the audio data of each channel corresponds to a plurality of frequency ranges; determining, for each of the plurality of frequency ranges for each channel, at least one of a speech audio energy level or a noise energy level by providing audio data corresponding to each frequency range as input to a model that is trained to determine at least one of a speech audio energy level of given audio data or a noise energy level of the given audio data; determining, based on at least one of the speech audio energy level or the noise energy level for each of the plurality of frequency ranges, a speech signal with removed noise for each channel associated with the audio data; for each channel, determining one or more statistical values associated with an energy level of a channel's speech signal with the removed noise; determining a strongest channel, wherein the strongest channel has highest one or more statistical values from the one or more statistical values associated with an energy level of a speech signal with the removed noise determined for each channel; determining that the one or more statistical values associated with the energy level of the speech signal of the strongest channel satisfy a threshold condition; comparing one or more statistical values associated with an energy level of a speech signal of each channel other than the strongest channel with the corresponding one or more statistical values associated with the energy level of the speech signal of the strongest channel; and depending on the comparing, determining whether to update a gain value for a respective channel based on the one or more statistical values associated with the energy level of the respective channel. receiving, through a plurality of channels, audio data, wherein the audio data of each channel corresponds to a plurality of frequency ranges; determining, for each of the plurality of frequency ranges for each channel, at least one of a speech audio energy level or a noise energy level by providing audio data corresponding to each frequency range as input to a model that is trained to determine at least one of a speech audio energy level of given audio data or a noise energy level of the given audio data; determining, based on at least one of the speech audio energy level or the noise energy level for each of the plurality of frequency ranges, a speech signal with removed noise for each channel associated with the audio data; for each channel, determining one or more statistical values associated with an energy level of a channel's speech signal with the removed noise; determining a strongest channel, wherein the strongest channel has highest one or more statistical values from the one or more statistical values associated with an energy level of a speech signal with the removed noise determined for each channel; determining that the one or more statistical values associated with the energy level of the speech signal of the strongest channel satisfy a threshold condition; comparing one or more statistical values associated with an energy level of a speech signal of each channel other than the strongest channel with the corresponding one or more statistical values associated with the energy level of the speech signal of the strongest channel; and depending on the comparing, determining whether to update a gain value for a respective channel based on the one or more statistical values associated with the energy level of the respective channel.