A device (10, 10') for enhancing speech captured using an in-ear microphone signal of a user in a noisy environment, the device (10, 10') comprising: an intra-aural unit (12, 12') adapted to be positioned into an ear of the user, the intra-aural unit (12, 12') having an in-ear microphone located inside an outer ear canal of the ear and an outer ear microphone adapted to be in fluid communication with an environment outside the ear; a transmitter; a processing unit operatively connected to the in-ear microphone to receive an internal signal therefrom, to the outer-ear microphone to receive an external signal therefrom and to the transmitter, the processing unit having an associated memory comprising instructions stored thereon, that when executed on the processing unit performing the steps of: acquiring the internal signal from the in-ear microphone; acquiring the external signal from the outer-ear microphone; applying an adaptive filter to the acquired in-ear microphone signal to produce a denoised signal, the adaptive filter: being initialized by an estimated transfer function of the intra-aural device (10, 10') based on the outer-ear microphone signal and the in-ear microphone signal; having an adaptation process continuously adjusting the estimated transfer function using the acquired in-ear microphone signal and outer ear microphone signal; characterized in that the processing unit further performs the steps of: detecting speech from the user by monitoring values of filter coefficients of the adaptive filter; interrupting application of the adaptation process upon detecting speech by the user; restarting the application of the adaptation process once speech is no longer detected; and providing the denoised signal via the transmitter. an intra-aural unit (12, 12') adapted to be positioned into an ear of the user, the intra-aural unit (12, 12') having an in-ear microphone located inside an outer ear canal of the ear and an outer ear microphone adapted to be in fluid communication with an environment outside the ear; a transmitter; a processing unit operatively connected to the in-ear microphone to receive an internal signal therefrom, to the outer-ear microphone to receive an external signal therefrom and to the transmitter, the processing unit having an associated memory comprising instructions stored thereon, that when executed on the processing unit performing the steps of: acquiring the internal signal from the in-ear microphone; acquiring the external signal from the outer-ear microphone; applying an adaptive filter to the acquired in-ear microphone signal to produce a denoised signal, the adaptive filter: being initialized by an estimated transfer function of the intra-aural device (10, 10') based on the outer-ear microphone signal and the in-ear microphone signal; having an adaptation process continuously adjusting the estimated transfer function using the acquired in-ear microphone signal and outer ear microphone signal; acquiring the internal signal from the in-ear microphone; acquiring the external signal from the outer-ear microphone; applying an adaptive filter to the acquired in-ear microphone signal to produce a denoised signal, the adaptive filter: being initialized by an estimated transfer function of the intra-aural device (10, 10') based on the outer-ear microphone signal and the in-ear microphone signal; having an adaptation process continuously adjusting the estimated transfer function using the acquired in-ear microphone signal and outer ear microphone signal; being initialized by an estimated transfer function of the intra-aural device (10, 10') based on the outer-ear microphone signal and the in-ear microphone signal; having an adaptation process continuously adjusting the estimated transfer function using the acquired in-ear microphone signal and outer ear microphone signal; detecting speech from the user by monitoring values of filter coefficients of the adaptive filter; interrupting application of the adaptation process upon detecting speech by the user; restarting the application of the adaptation process once speech is no longer detected; and providing the denoised signal via the transmitter.