Backtrack if we find a bad frame because we probably skipped over a frame