Right. So technically there is no queue in the codec, it's just the minimum amount of frames needed to do deinterlace. That is perfectly fine.

I just don't like the api change. It should be solvable with return values from decode since I see no need for the PTS value returned. What do you need it for. Note decoder doesn't even know PTS until it has finished decoding a frame.

Could you explain to me what the PTS value is for. Then maybe I can understand the need for it.