Don't prune backlog from scrolled up buffers