An apparatus for compressing a set of N binaural room impulse responses, BRIR, wherein the apparatus is configured to convolve each channel of an N channel audio signal (I1, I2,..., IN) with the corresponding compressed set of N BRIR, the apparatus comprising: at least one analyzing and compressor module (10, 20) adapted to separate an input binaural room impulse response signal (IBRIR) into a first binaural signal set provided to an early binauralization processing and a second binaural signal set provided to a late binauralization processing via a downmix module (10-7, 20-7); a binauralization module adapted to obtain a binaural signal (LS, RS) based on convolving the N channel audio signal (I1, I2,..., IN) with the first binaural signal set and the second binaural signal set, wherein the at least one analyzing and compressor module (10, 20) comprises: a filter bank unit (10-1, 20-1) adapted to filter the input binaural room impulse response signal (IBRIR) generating a bandwidth limited binaural room impulse response signal for each subband; and, a truncation module (10-2, 20-2) adapted to discard excess bits of the input binaural room impulse response signal (IBRIR) in each subband using a perceptual relevant parameter; wherein the apparatus is characterised in that the at least one analyzing and compressor module (10, 20) further comprises: a Hilbert module (10-4, 20-4) adapted to calculate a Hilbert envelope of the first binaural signal set and/or the second binaural signal set; a demodulation module (10-5, 20-5) adapted to demodulate the calculated Hilbert envelope of the first binaural signal set (FS 1) and/or the second binaural signal set; and, a down-sampling module (10-6, 20-6) adapted to down-sample the demodulated Hilbert envelope of the first binaural signal set and/or the second binaural signal set. at least one analyzing and compressor module (10, 20) adapted to separate an input binaural room impulse response signal (IBRIR) into a first binaural signal set provided to an early binauralization processing and a second binaural signal set provided to a late binauralization processing via a downmix module (10-7, 20-7); a binauralization module adapted to obtain a binaural signal (LS, RS) based on convolving the N channel audio signal (I1, I2,..., IN) with the first binaural signal set and the second binaural signal set, wherein the at least one analyzing and compressor module (10, 20) comprises: a filter bank unit (10-1, 20-1) adapted to filter the input binaural room impulse response signal (IBRIR) generating a bandwidth limited binaural room impulse response signal for each subband; and, a truncation module (10-2, 20-2) adapted to discard excess bits of the input binaural room impulse response signal (IBRIR) in each subband using a perceptual relevant parameter; wherein the apparatus is characterised in that the at least one analyzing and compressor module (10, 20) further comprises: a Hilbert module (10-4, 20-4) adapted to calculate a Hilbert envelope of the first binaural signal set and/or the second binaural signal set; a demodulation module (10-5, 20-5) adapted to demodulate the calculated Hilbert envelope of the first binaural signal set (FS 1) and/or the second binaural signal set; and, a down-sampling module (10-6, 20-6) adapted to down-sample the demodulated Hilbert envelope of the first binaural signal set and/or the second binaural signal set. a filter bank unit (10-1, 20-1) adapted to filter the input binaural room impulse response signal (IBRIR) generating a bandwidth limited binaural room impulse response signal for each subband; and, a truncation module (10-2, 20-2) adapted to discard excess bits of the input binaural room impulse response signal (IBRIR) in each subband using a perceptual relevant parameter; wherein the apparatus is characterised in that the at least one analyzing and compressor module (10, 20) further comprises: a Hilbert module (10-4, 20-4) adapted to calculate a Hilbert envelope of the first binaural signal set and/or the second binaural signal set; a demodulation module (10-5, 20-5) adapted to demodulate the calculated Hilbert envelope of the first binaural signal set (FS 1) and/or the second binaural signal set; and, a down-sampling module (10-6, 20-6) adapted to down-sample the demodulated Hilbert envelope of the first binaural signal set and/or the second binaural signal set. a Hilbert module (10-4, 20-4) adapted to calculate a Hilbert envelope of the first binaural signal set and/or the second binaural signal set; a demodulation module (10-5, 20-5) adapted to demodulate the calculated Hilbert envelope of the first binaural signal set (FS 1) and/or the second binaural signal set; and, a down-sampling module (10-6, 20-6) adapted to down-sample the demodulated Hilbert envelope of the first binaural signal set and/or the second binaural signal set.