An apparatus for generating one or more audio output signals, comprising: a signal processor, and an output interface, wherein the signal processor is configured to receive a direct component signal, comprising direct signal components of two or more original audio signals, wherein the signal processor is configured to receive a diffuse component signal, comprising diffuse signal components of the two or more original audio signals, and wherein the signal processor is configured to receive direction information, said direction information depending on a direction of arrival of the direct signal components of the two or more original audio signals, wherein the signal processor is configured to generate one or more processed diffuse signals depending on the diffuse component signal, wherein, for each audio output signal of the one or more audio output signals, the signal processor is configured to determine, depending on the direction of arrival, a direct gain being a gain value, the signal processor is configured to apply said direct gain on the direct component signal to obtain a processed direct signal, and the signal processor is configured to combine said processed direct signal and one of the one or more processed diffuse signals to generate said audio output signal, and wherein the output interface is configured to output the one or more audio output signals, wherein the signal processor comprises a gain function computation module for calculating one or more gain functions, wherein each gain function of the one or more gain functions is calculated for one of the one or more audio output signals, wherein each gain function of the one or more gain functions comprises a plurality of gain function argument values, wherein a gain function return value is assigned to each of said gain function argument values, wherein, when said gain function receives one of said gain function argument values, said gain function is configured to return the gain function return value being assigned to said one of said gain function argument values, and wherein the signal processor further comprises a signal modifier for selecting, for each gain function of the one or more gain functions, depending on the direction of arrival, a direction dependent argument value from the gain function argument values of said gain function, for obtaining the gain function return value being assigned to said direction dependent argument value from said gain function, and for determining the gain value of at least one of the one or more audio output signals depending on said gain function return value obtained from said gain function, wherein the calculating of the one or more gain functions requires at least one of a zooming factor and a width of a visual image and a look direction and information on a loudspeaker setup. a signal processor, and an output interface, wherein the signal processor is configured to receive a direct component signal, comprising direct signal components of two or more original audio signals, wherein the signal processor is configured to receive a diffuse component signal, comprising diffuse signal components of the two or more original audio signals, and wherein the signal processor is configured to receive direction information, said direction information depending on a direction of arrival of the direct signal components of the two or more original audio signals, wherein the signal processor is configured to generate one or more processed diffuse signals depending on the diffuse component signal, wherein, for each audio output signal of the one or more audio output signals, the signal processor is configured to determine, depending on the direction of arrival, a direct gain being a gain value, the signal processor is configured to apply said direct gain on the direct component signal to obtain a processed direct signal, and the signal processor is configured to combine said processed direct signal and one of the one or more processed diffuse signals to generate said audio output signal, and wherein the output interface is configured to output the one or more audio output signals, wherein the signal processor comprises a gain function computation module for calculating one or more gain functions, wherein each gain function of the one or more gain functions is calculated for one of the one or more audio output signals, wherein each gain function of the one or more gain functions comprises a plurality of gain function argument values, wherein a gain function return value is assigned to each of said gain function argument values, wherein, when said gain function receives one of said gain function argument values, said gain function is configured to return the gain function return value being assigned to said one of said gain function argument values, and wherein the signal processor further comprises a signal modifier for selecting, for each gain function of the one or more gain functions, depending on the direction of arrival, a direction dependent argument value from the gain function argument values of said gain function, for obtaining the gain function return value being assigned to said direction dependent argument value from said gain function, and for determining the gain value of at least one of the one or more audio output signals depending on said gain function return value obtained from said gain function, wherein the calculating of the one or more gain functions requires at least one of a zooming factor and a width of a visual image and a look direction and information on a loudspeaker setup.