A video processing system, comprising: - an encoder configured to generate an encoded video data stream; - a decoder configured to receive and decode the encoded video data stream; and - a display management module configured to receive the decoded video data stream and to perform dynamic range mapping using luminance statistics based metadata, wherein the encoder is configured to: - divide the video data stream into a set of scenes; - generate first metadata associated with a first scene within the set of scenes, the first metadata being generated on a frame-by-frame basis and including luminance statistics based metadata; - generate scene stable metadata for ensuring a feature to be displayed in a video playback on a target display is temporally stable at least over a scene, the scene stable metadata being different from the first metadata, generating scene stable metadata comprising determining scene-by-scene luminance statistics metadata by: ∘ computing the min, mid and max luminance for each frame in the first scene; ∘ computing the min luminance for the scene as the minimum of the min luminances of the frames of the first scene; ∘ computing the mid luminance for the scene as the mid of the mid luminances of the frames of the first scene; and ∘ computing the max luminance for the scene as the maximum of the max luminances of the frames of the first scene, and - associate the scene stable metadata with said first scene, comprising substituting the scene-by-scene metadata for the frame-by-frame metadata. - an encoder configured to generate an encoded video data stream; - a decoder configured to receive and decode the encoded video data stream; and - a display management module configured to receive the decoded video data stream and to perform dynamic range mapping using luminance statistics based metadata, - divide the video data stream into a set of scenes; - generate first metadata associated with a first scene within the set of scenes, the first metadata being generated on a frame-by-frame basis and including luminance statistics based metadata; - generate scene stable metadata for ensuring a feature to be displayed in a video playback on a target display is temporally stable at least over a scene, the scene stable metadata being different from the first metadata, generating scene stable metadata comprising determining scene-by-scene luminance statistics metadata by: ∘ computing the min, mid and max luminance for each frame in the first scene; ∘ computing the min luminance for the scene as the minimum of the min luminances of the frames of the first scene; ∘ computing the mid luminance for the scene as the mid of the mid luminances of the frames of the first scene; and ∘ computing the max luminance for the scene as the maximum of the max luminances of the frames of the first scene, and ∘ computing the min, mid and max luminance for each frame in the first scene; ∘ computing the min luminance for the scene as the minimum of the min luminances of the frames of the first scene; ∘ computing the mid luminance for the scene as the mid of the mid luminances of the frames of the first scene; and ∘ computing the max luminance for the scene as the maximum of the max luminances of the frames of the first scene, and - associate the scene stable metadata with said first scene, comprising substituting the scene-by-scene metadata for the frame-by-frame metadata.