A high dynamic range video decoder arranged to receive an encoding (Im_COD) of a high dynamic range video and to decode and output a set of temporally successive images (Im_RHDR) comprising: - an input to receive three weight values (kRY, kGY, kBY); - a video decoder arranged to decode the encoding (Im_COD) into an intermediate image (Im_RLDR) being in a Y'CbCr color representation; - a brightness index calculation unit arranged to calculate for each pixel of the intermediate image (Im RLDR) a brightness index (J') being defined as J'=Y'+MAX{kRY*(R'-Y'), kGY*(G'-Y'), kBY*(B'-Y')} where kRY, kGY, kBY represents the three weight values, Y' is the luma value of the Y'CbCr color representation, and R', G', and B' are non-linear color component values derived from the Y', Cb and Cr values of the Y'CbCr color representation; - a brightness mapper arranged to receive a specification of at least one function F_ct, which at least one function relates input brightness indices of pixels of an image of the high dynamic range video to output brightness indices of pixels of an SDR image corresponding to the image of the high dynamic range video, and to apply the inverse of this at least one function with the brightness index, J', calculated by the brightness index calculation unit as input, to obtain an output brightness index, J ∗; - a color processing unit arranged to determine an output color (Y'H, Cb'H, Cr'H) for that each pixel in the output dynamic range image (Im_RHDR) of the set of temporally successive images being currently decoded, which is arranged to determine the output luma Y' to correspond to an output luminance being the input luminance of the color of the each pixel multiplied by a factor which is determined as a function of the ratio of the output brightness index, J ∗, divided by the brightness index, J'. - an input to receive three weight values (kRY, kGY, kBY); - a video decoder arranged to decode the encoding (Im_COD) into an intermediate image (Im_RLDR) being in a Y'CbCr color representation; - a brightness index calculation unit arranged to calculate for each pixel of the intermediate image (Im RLDR) a brightness index (J') being defined as J'=Y'+MAX{kRY*(R'-Y'), kGY*(G'-Y'), kBY*(B'-Y')} where kRY, kGY, kBY represents the three weight values, Y' is the luma value of the Y'CbCr color representation, and R', G', and B' are non-linear color component values derived from the Y', Cb and Cr values of the Y'CbCr color representation; - a brightness mapper arranged to receive a specification of at least one function F_ct, which at least one function relates input brightness indices of pixels of an image of the high dynamic range video to output brightness indices of pixels of an SDR image corresponding to the image of the high dynamic range video, and to apply the inverse of this at least one function with the brightness index, J', calculated by the brightness index calculation unit as input, to obtain an output brightness index, J ∗; - a color processing unit arranged to determine an output color (Y'H, Cb'H, Cr'H) for that each pixel in the output dynamic range image (Im_RHDR) of the set of temporally successive images being currently decoded, which is arranged to determine the output luma Y' to correspond to an output luminance being the input luminance of the color of the each pixel multiplied by a factor which is determined as a function of the ratio of the output brightness index, J ∗, divided by the brightness index, J'.