Apparatus for generating an encoded audio scene from an audio signal having a first frame and a second frame, comprising: a soundfield parameter generator for determining a first soundfield parameter representation for the first frame from the audio signal in the first frame and a second soundfield parameter representation for the second frame from the audio signal in the second frame; and an activity detector for analyzing the audio signal to determine, depending on the audio signal, that the first frame is an active frame and the second frame is an inactive frame, wherein the soundfield parameter generator is configured to determine, from the second frame of the audio signal, a plurality of individual sound sources and to determine, for each sound source, a parametric description for the second frame, wherein the soundfield parameter generator is configured to decompose the second frame into a plurality of frequency bins, each frequency bin representing an individual sound source of the plurality of individual sound sources, and to determine, for each frequency bin, at least one inactive spatial parameter as the second soundfield parameter representation for the second frame, the at least one inactive spatial parameter comprising a direction parameter, a direction of arrival parameter, a diffuseness parameter, or an energy ratio parameter, the apparatus further comprising: an audio signal encoder for generating an encoded audio signal, the encoded audio signal providing an encoded audio signal for the first frame being the active frame and the parametric description for the second frame being the inactive frame; and an encoded signal former for composing the encoded audio scene by bringing together the first soundfield parameter representation for the first frame, the second soundfield parameter representation for the second frame, the encoded audio signal for the first frame, and the parametric description for the second frame. a soundfield parameter generator for determining a first soundfield parameter representation for the first frame from the audio signal in the first frame and a second soundfield parameter representation for the second frame from the audio signal in the second frame; and an activity detector for analyzing the audio signal to determine, depending on the audio signal, that the first frame is an active frame and the second frame is an inactive frame, wherein the soundfield parameter generator is configured to determine, from the second frame of the audio signal, a plurality of individual sound sources and to determine, for each sound source, a parametric description for the second frame, wherein the soundfield parameter generator is configured to decompose the second frame into a plurality of frequency bins, each frequency bin representing an individual sound source of the plurality of individual sound sources, and to determine, for each frequency bin, at least one inactive spatial parameter as the second soundfield parameter representation for the second frame, the at least one inactive spatial parameter comprising a direction parameter, a direction of arrival parameter, a diffuseness parameter, or an energy ratio parameter, the apparatus further comprising: an audio signal encoder for generating an encoded audio signal, the encoded audio signal providing an encoded audio signal for the first frame being the active frame and the parametric description for the second frame being the inactive frame; and an encoded signal former for composing the encoded audio scene by bringing together the first soundfield parameter representation for the first frame, the second soundfield parameter representation for the second frame, the encoded audio signal for the first frame, and the parametric description for the second frame. an audio signal encoder for generating an encoded audio signal, the encoded audio signal providing an encoded audio signal for the first frame being the active frame and the parametric description for the second frame being the inactive frame; and an encoded signal former for composing the encoded audio scene by bringing together the first soundfield parameter representation for the first frame, the second soundfield parameter representation for the second frame, the encoded audio signal for the first frame, and the parametric description for the second frame.