Apparatus for decoding a significance map encoded in a data stream, wherein the significance map indicates positions of significant transform coefficients within a transform coefficient block, the apparatus comprising: a decoder configured to extract the significance map, and the values of the significant transform coefficients within the transform coefficient block from the data stream, with, in extracting the significance map, sequentially extract, by context-adaptive entropy coding, first-type syntax elements from the data stream, wherein each of the first-type syntax elements at least indicates, for an associated position within the transform coefficient block, whether a significant transform coefficient is present; and an associator configured to sequentially associate each of the extracted first-type syntax elements with a respective associated position within the transform coefficient block in a predetermined scan order among the positions of the transform coefficient block, characterized in that the decoder is configured to extract the first-type syntax elements based on context-adaptive entropy decoding using contexts selected for the first-type syntax elements, wherein a context for a current first-type syntax element being decoded is determined based on a number of positions in a predetermined neighborhood with respect to the position of the current first-type syntax element, where only positions are counted that are associated with significant transform coefficients indicated by prior first-type syntax elements previously extracted, the predetermined neighborhood being situated within the transform coefficient block, the size of the transform coefficient block being larger than 8x8. a decoder configured to extract the significance map, and the values of the significant transform coefficients within the transform coefficient block from the data stream, with, in extracting the significance map, sequentially extract, by context-adaptive entropy coding, first-type syntax elements from the data stream, wherein each of the first-type syntax elements at least indicates, for an associated position within the transform coefficient block, whether a significant transform coefficient is present; and an associator configured to sequentially associate each of the extracted first-type syntax elements with a respective associated position within the transform coefficient block in a predetermined scan order among the positions of the transform coefficient block, characterized in that the decoder is configured to extract the first-type syntax elements based on context-adaptive entropy decoding using contexts selected for the first-type syntax elements, wherein a context for a current first-type syntax element being decoded is determined based on a number of positions in a predetermined neighborhood with respect to the position of the current first-type syntax element, where only positions are counted that are associated with significant transform coefficients indicated by prior first-type syntax elements previously extracted, the predetermined neighborhood being situated within the transform coefficient block, the size of the transform coefficient block being larger than 8x8.