A decoder for generating an audio output signal comprising one or more audio output channels from a downmix signal comprising three or more downmix channels, wherein the downmix signal encodes three or more audio object signals, wherein the decoder comprises: an input channel router for receiving the three or more downmix channels and for receiving side information, and at least two channel processing units (121, 122, 123, 124, 125, 126) for generating at least two processed channels to obtain the one or more audio output channels, wherein the input channel router is configured to feed each of at least two of the three or more downmix channels into at least one of the at least two channel processing units (121, 122, 123, 124, 125, 126), so that each of the at least two channel processing units (121, 122, 123, 124, 125, 126) receives one or more of the three or more downmix channels, and so that each of the at least two channel processing units (121, 122, 123, 124, 125, 126) receives less than the total number of the three or more downmix channels, wherein each channel processing unit of the at least two channel processing units (121, 122, 123, 124, 125, 126) is configured to generate one or more of the at least two processed channels depending on the side information and depending on said one or more of the at least two of the three or more downmix channels received by said channel processing unit from the input channel router, wherein the at least two channel processing units (121, 122, 123, 124, 125, 126) are configured to generate the at least two processed channels in parallel, wherein the decoder further comprises an output channel router, wherein the output channel router is configured to combine the at least two processed channels to obtain an estimation of the audio object signals, wherein the decoder further comprises a renderer, wherein the renderer is configured to receive rendering information and is configured to generate the one or more audio output channels depending on the estimation of the audio object signals and depending on the rendering information, wherein the input channel router is configured to not feed at least one of the three or more downmix channels into any of the at least two channel processing units (121, 122, 123, 124, 125, 126), so that said at least one of the three or more downmix channels is not received by any of the at least two channel processing units (121, 122, 123, 124, 125, 126). an input channel router for receiving the three or more downmix channels and for receiving side information, and at least two channel processing units (121, 122, 123, 124, 125, 126) for generating at least two processed channels to obtain the one or more audio output channels, wherein the input channel router is configured to feed each of at least two of the three or more downmix channels into at least one of the at least two channel processing units (121, 122, 123, 124, 125, 126), so that each of the at least two channel processing units (121, 122, 123, 124, 125, 126) receives one or more of the three or more downmix channels, and so that each of the at least two channel processing units (121, 122, 123, 124, 125, 126) receives less than the total number of the three or more downmix channels, wherein each channel processing unit of the at least two channel processing units (121, 122, 123, 124, 125, 126) is configured to generate one or more of the at least two processed channels depending on the side information and depending on said one or more of the at least two of the three or more downmix channels received by said channel processing unit from the input channel router, wherein the at least two channel processing units (121, 122, 123, 124, 125, 126) are configured to generate the at least two processed channels in parallel, wherein the decoder further comprises an output channel router, wherein the output channel router is configured to combine the at least two processed channels to obtain an estimation of the audio object signals, wherein the decoder further comprises a renderer, wherein the renderer is configured to receive rendering information and is configured to generate the one or more audio output channels depending on the estimation of the audio object signals and depending on the rendering information, wherein the input channel router is configured to not feed at least one of the three or more downmix channels into any of the at least two channel processing units (121, 122, 123, 124, 125, 126), so that said at least one of the three or more downmix channels is not received by any of the at least two channel processing units (121, 122, 123, 124, 125, 126).