Perhaps only set last_frame_ if consumer_frame is not late? In that way it will not flicker when the source is going in 25fps and the target is going in 50fps for example.