A method for tone-mapping video frames based on filtered metadata with a processor, the method comprising: accessing with a processor an input video stream comprising video frames; accessing input metadata for the input video stream, the input metadata comprising at least one of minimum ( min), average ( mid), or maximum ( max) luminance values of the video frames in the input video stream; and for an input frame in the input video stream: testing whether the input frame belongs to a current scene or a new scene; and upon determining the input frame belongs to the current scene: filtering the input metadata to generate output metadata for the input frame, wherein the filtering is based only on metadata from input frames belonging to the current scene, wherein said filtering comprises computing the output metadata with an exponential moving average filter as: St = L F 0, for t = 0, S t = α k ∗ L F t + β ∗ S t − 1, for t > 0, where S t denotes the output metadata, α k (alpha) and β (beta) denote weight factors, L F ( t) denotes a function of the at least one of min, mid, or max luminance values for the input frame at time t, and t =0 denotes the start of the current scene, wherein α k is computed as a function of a delivery frame rate such that α k decreases when the delivery frame rate increases; and generating, using the output metadata, an output tone-mapped frame by mapping the dynamic range of the input frame to the dynamic range of a target display. accessing with a processor an input video stream comprising video frames; accessing input metadata for the input video stream, the input metadata comprising at least one of minimum ( min), average ( mid), or maximum ( max) luminance values of the video frames in the input video stream; and for an input frame in the input video stream: testing whether the input frame belongs to a current scene or a new scene; and upon determining the input frame belongs to the current scene: filtering the input metadata to generate output metadata for the input frame, wherein the filtering is based only on metadata from input frames belonging to the current scene, wherein said filtering comprises computing the output metadata with an exponential moving average filter as: St = L F 0, for t = 0, S t = α k ∗ L F t + β ∗ S t − 1, for t > 0, where S t denotes the output metadata, α k (alpha) and β (beta) denote weight factors, L F ( t) denotes a function of the at least one of min, mid, or max luminance values for the input frame at time t, and t =0 denotes the start of the current scene, wherein α k is computed as a function of a delivery frame rate such that α k decreases when the delivery frame rate increases; and where S t denotes the output metadata, α k (alpha) and β (beta) denote weight factors, L F ( t) denotes a function of the at least one of min, mid, or max luminance values for the input frame at time t, and t =0 denotes the start of the current scene, wherein α k is computed as a function of a delivery frame rate such that α k decreases when the delivery frame rate increases; and generating, using the output metadata, an output tone-mapped frame by mapping the dynamic range of the input frame to the dynamic range of a target display.