A method of decoding a compressed Higher Order Ambisonics, HOA, representation of a sound or sound field, the method comprising: receiving a bit stream containing the compressed HOA representation corresponding to a plurality of hierarchical layers that include a base layer and two or more hierarchical enhancement layers, and containing basic side information that is associated with the base layer and enhancement side information that is associated with the two or more hierarchical enhancement layers, wherein the plurality of layers have assigned thereto components of a basic compressed sound representation of the sound or sound field, the components being assigned to respective layers in respective groups of components, wherein the components of the basic compressed sound representation correspond to monaural signals, the monaural signals represent either predominant sound signals or coefficient sequences of an HOA representation, wherein the two or more hierarchical enhancement layers comprises a highest usable hierarchical enhancement layer, wherein each of the two or more hierarchical enhancement layers includes a portion of the enhancement side information including parameters for improving a basic reconstructed sound representation obtainable from data included in the respective layer and any layers lower than the respective layer; and wherein the method further comprises decoding the compressed HOA representation based on the basic side information that is associated with the base layer, based on the portion of the enhancement side information that is associated with the highest usable hierarchical enhancement layer, and not based on the portion of the enhancement side information that is associated with any other layer of the two or more hierarchical enhancement layers. receiving a bit stream containing the compressed HOA representation corresponding to a plurality of hierarchical layers that include a base layer and two or more hierarchical enhancement layers, and containing basic side information that is associated with the base layer and enhancement side information that is associated with the two or more hierarchical enhancement layers, wherein the plurality of layers have assigned thereto components of a basic compressed sound representation of the sound or sound field, the components being assigned to respective layers in respective groups of components, wherein the components of the basic compressed sound representation correspond to monaural signals, the monaural signals represent either predominant sound signals or coefficient sequences of an HOA representation, wherein the two or more hierarchical enhancement layers comprises a highest usable hierarchical enhancement layer, wherein each of the two or more hierarchical enhancement layers includes a portion of the enhancement side information including parameters for improving a basic reconstructed sound representation obtainable from data included in the respective layer and any layers lower than the respective layer; and wherein the method further comprises decoding the compressed HOA representation based on the basic side information that is associated with the base layer, based on the portion of the enhancement side information that is associated with the highest usable hierarchical enhancement layer, and not based on the portion of the enhancement side information that is associated with any other layer of the two or more hierarchical enhancement layers.