Continue seeking backwards if we're unable to find the last packet.

There's also some other cleanups happening here.