Scalable video decoder configured to reconstruct a base layer signal from a base layer substream of a coded data stream to obtain a reconstructed base layer signal; reconstruct an enhancement layer signal comprising spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal, wherein the spatially or temporally predicting is controlled via intra prediction parameters in an enhancement layer substream of the coded data stream; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components, wherein the formation is controlled via weighting parameters in the enhancement layer substream; and predictively reconstructing the enhancement layer signal by combining the enhancement layer prediction signal and a residual signal signaled by residual information in the enhancement layer substream; wherein the scalable video decoder is further configured to, in forming the weighted average, filter, at the portion currently to be reconstructed, the inter-layer prediction signal with a first filter and filter the enhancement layer internal prediction signal with a second filter to obtain filtered signals, and add-up the obtained filtered signals, the first and second filter having different transfer functions, characterized in that the base layer substream and the enhancement layer substream are such that a picture coded into the enhancement layer substream has higher spatial resolution than a picture coded into the base layer substream. reconstruct a base layer signal from a base layer substream of a coded data stream to obtain a reconstructed base layer signal; reconstruct an enhancement layer signal comprising spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal, wherein the spatially or temporally predicting is controlled via intra prediction parameters in an enhancement layer substream of the coded data stream; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components, wherein the formation is controlled via weighting parameters in the enhancement layer substream; and predictively reconstructing the enhancement layer signal by combining the enhancement layer prediction signal and a residual signal signaled by residual information in the enhancement layer substream; spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal, wherein the spatially or temporally predicting is controlled via intra prediction parameters in an enhancement layer substream of the coded data stream; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components, wherein the formation is controlled via weighting parameters in the enhancement layer substream; and predictively reconstructing the enhancement layer signal by combining the enhancement layer prediction signal and a residual signal signaled by residual information in the enhancement layer substream; wherein the scalable video decoder is further configured to, in forming the weighted average, filter, at the portion currently to be reconstructed, the inter-layer prediction signal with a first filter and filter the enhancement layer internal prediction signal with a second filter to obtain filtered signals, and add-up the obtained filtered signals, the first and second filter having different transfer functions, characterized in that the base layer substream and the enhancement layer substream are such that a picture coded into the enhancement layer substream has higher spatial resolution than a picture coded into the base layer substream.