Properly track pts in case the associated frame is consumed at next
::Decode call