A conference controller (111, 175) configured to place a plurality of upstream audio signals (123, 173) associated with a plurality of conference participants within a 2D or 3D conference scene to be rendered to a listener, wherein the conference controller (111, 175) is configured to - set up a X-point conference scene with X different spatial talker locations within the conference scene, X being an integer, X>0; wherein the X talker locations are positioned within a cone around a midline in front of the head of the listener; wherein a generatrix of the cone and the midline form an angle which is smaller than or equal to a pre-determined maximum cone angle; - determine a preferred side of the listener; wherein the preferred side is a left side or a right side from the midline; wherein the preferred side of the listener is determined based on a preference setting of a terminal used for rendering the 2D or 3D conference scene to the listener; - assign the plurality of upstream audio signals (123, 173) to respective ones of the X talker locations in accordance to a sequential order of the plurality of upstream audio signals, while starting to populate the X-point conference scene on the preferred side of the listener, such that, while populating the X-point conference scene, the X-point conference scene leans towards the preferred side of the listener; and - generate metadata identifying the assigned talker location and enabling an audio processing unit (121, 171) to generate a spatialized audio signal based on the upstream audio signal (123, 173); - wherein when rendering the spatialized audio signal to the listener, the listener perceives the upstream audio signal (123, 173) as coming from the assigned talker location. - set up a X-point conference scene with X different spatial talker locations within the conference scene, X being an integer, X>0; wherein the X talker locations are positioned within a cone around a midline in front of the head of the listener; wherein a generatrix of the cone and the midline form an angle which is smaller than or equal to a pre-determined maximum cone angle; - determine a preferred side of the listener; wherein the preferred side is a left side or a right side from the midline; wherein the preferred side of the listener is determined based on a preference setting of a terminal used for rendering the 2D or 3D conference scene to the listener; - assign the plurality of upstream audio signals (123, 173) to respective ones of the X talker locations in accordance to a sequential order of the plurality of upstream audio signals, while starting to populate the X-point conference scene on the preferred side of the listener, such that, while populating the X-point conference scene, the X-point conference scene leans towards the preferred side of the listener; and - generate metadata identifying the assigned talker location and enabling an audio processing unit (121, 171) to generate a spatialized audio signal based on the upstream audio signal (123, 173); - wherein when rendering the spatialized audio signal to the listener, the listener perceives the upstream audio signal (123, 173) as coming from the assigned talker location.